00000001:02000400:2.0F:1789297035.490598:0:2954:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_hostid 00000001:02000400:2.0:1789297058.516234:0:3180:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing load_modules_local 00000001:01000000:1.0F:1789297060.300406:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 799 MB/s 00000001:01000000:3.0F:1789297060.550022:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 963 MB/s 00000001:01000000:1.0:1789297060.802877:0:3242:0:(lnet-crypto.c:360:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 5177 MB/s 00000020:02000000:2.0:1789297061.765257:0:3271:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_108_gfed9771 00000400:02000000:1.0:1789297063.082042:0:3286:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.202.143@tcp [8/256/0/180] 00008000:02000000:0.0F:1789297067.407585:0:3436:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:2.0:1789297124.084512:0:5241:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1789297135.953032:0:5822:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1789297135.953039:0:5822:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1789297135.953175:0:5822:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000e87995bb 00000080:02000400:2.0:1789297135.953186:0:5822:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1789297135.965065:0:5822:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1789297135.965081:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1789297135.965123:0:5822:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000a2d8a078) 00000020:00000080:2.0:1789297135.965145:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789297135.987246:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:0.0:1789297135.991133:0:5822:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1789297136.032304:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789297136.032362:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789297136.032384:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789297136.032435:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789297136.032640:0:5822:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789297136.033196:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789297136.033205:0:5822:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789297136.033215:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0b0e6 00000020:01000004:2.0:1789297136.033223:0:5822:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789297136.033229:0:5822:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789297136.033233:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e87995bb from MGS 00000020:01000004:2.0:1789297136.033238:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789297136.033248:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGS (000000007a175671) 00000020:00000080:2.0:1789297136.033257:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789297136.033394:0:5822:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e87995bb from MGS, refs=2 00080000:01000000:2.0:1789297136.033401:0:5822:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789297136.033406:0:5822:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0b0f4 00000100:00100000:2.0:1789297136.033568:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789297136.033798:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789297136.033811:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1789297136.036274:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1789297136.036286:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1789297136.037306:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297136.037764:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1789297136.037771:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1789297136.039142:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1789297136.039153:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1789297136.039823:0:5822:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1789297136.039830:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789297136.040698:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297136.040789:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297136.040792:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297136.041193:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297136.041196:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297136.041197:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297136.045783:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789297136.053408:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:2.0:1789297136.295993:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 1848 MB/s 00000001:01000000:2.0:1789297136.545836:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2951 MB/s 00000001:01000000:1.0:1789297136.796307:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 511 MB/s 00000001:01000000:2.0:1789297137.048030:0:5822:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 658 MB/s 00080000:10000000:3.0:1789297137.080223:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:1.0:1789297137.085641:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789297137.108424:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789297137.108441:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789297137.108444:0:5822:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:0.0:1789297137.117186:0:5833:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789297137.117287:0:5822:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789297137.117350:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1789297137.117584:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1789297137.117613:0:5822:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789297137.118389:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789297137.118586:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789297137.118593:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789297137.121628:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789297137.121640:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1789297137.122152:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1789297137.122166:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1789297137.122658:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1789297137.122681:0:5822:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.143@tcp' 00000020:01000004:3.0:1789297137.122683:0:5822:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1789297137.122902:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.143@tcp (typ=mgc) 00000020:00000080:3.0:1789297137.122920:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.143@tcp (000000005adca6f6) 00000020:00000080:3.0:1789297137.122938:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1789297137.123017:0:5822:0:(ldlm_lib.c:102:import_set_conn()) imp 00000000681e1f1a@MGC192.168.202.143@tcp: add connection 192.168.202.143@tcp at head 00010000:00010000:3.0:1789297137.123177:0:5822:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.143@tcp-0 is initialized 00000040:01000000:3.0:1789297137.123184:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 1 is initialized 10000000:01000000:3.0:1789297137.129904:0:5839:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:3.0:1789297137.129952:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.143@tcp (uuid f5de263b-4dfd-46a5-a3a7-afaeb125f055) 00000020:00000080:3.0:1789297137.129979:0:5822:0:(genops.c:1385:class_connect()) connect: client f5de263b-4dfd-46a5-a3a7-afaeb125f055, cookie 0x8ad177e823a0b102 00000100:00080000:3.0:1789297137.130001:0:5822:0:(import.c:510:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789297137.130008:0:5822:0:(import.c:624:import_select_connection()) MGC192.168.202.143@tcp: import 00000000681e1f1a using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789297137.130051:0:5822:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000edb95803 x1876213957132416/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789297137.131286:0:5838:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 00000100:00080000:3.0:1789297137.134880:0:5822:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f5de263b-4dfd-46a5-a3a7-afaeb125f055->MGS 00000020:01000004:3.0:1789297137.134923:0:5822:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:3.0:1789297137.134932:0:5822:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:3.0:1789297137.134952:0:5822:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000090349d21) 00000020:00000080:3.0:1789297137.134974:0:5822:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1789297137.139865:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000edb95803 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3301:1876213957132416:0@lo:250: 00000100:00100000:0.0:1789297137.140436:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297137.140525:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957132416 00000100:00100000:0.0:1789297137.140533:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957132416 00000100:00100000:0.0:1789297137.140575:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789297137.140581:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e7b88584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1876213957132416:12345-0@lo:250: 00010000:00080000:0.0:1789297137.140609:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f5de263b-4dfd-46a5-a3a7-afaeb125f055@0@lo t0 exp 0000000000000000 cur 149 last 0 00000020:00000080:0.0:1789297137.140636:0:5835:0:(genops.c:1385:class_connect()) connect: client f5de263b-4dfd-46a5-a3a7-afaeb125f055, cookie 0x8ad177e823a0b110 00000100:00080000:0.0:1789297137.141032:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000ff2c5394 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789297137.141091:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e7b88584 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:3301:x1876213957132416:12345-0@lo:250: Request processed in 508us (656us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297137.141100:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789297137.141150:0:3301:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1789297137.141159:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.143@tcp: connect to target with instance 0 00000100:00080000:0.0:1789297137.141167:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1789297137.141172:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1789297137.141182:0:3301:0:(import.c:65:import_set_state_nolock()) 00000000681e1f1a MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1789297137.141185:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1789297137.141189:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1789297137.141193:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000edb95803 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3301:1876213957132416:0@lo:250: 00000100:00100000:3.0:1789297137.161916:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789297137.162167:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:3.0:1789297137.162174:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:3.0:1789297137.170814:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:3.0:1789297137.170833:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:3.0:1789297137.172125:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:3.0:1789297137.172134:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789297137.187892:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297137.188118:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789297137.188133:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:3.0:1789297137.190254:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:3.0:1789297137.190268:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1789297137.229917:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297137.230161:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1789297137.230167:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1789297137.231543:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1789297137.231562:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:1.0:1789297137.232279:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789297137.232460:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789297137.232466:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789297137.233105:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789297137.233112:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789297137.233638:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297137.234026:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789297137.234031:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789297137.234497:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789297137.234504:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1789297137.235263:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297137.235919:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789297137.235926:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789297137.236365:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789297137.236371:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:3.0:1789297137.261998:0:5822:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789297137.262246:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789297137.262254:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:3.0:1789297137.263437:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789297137.263461:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:3.0:1789297137.265485:0:5822:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789297137.265500:0:5822:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:3.0:1789297137.266379:0:5822:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:3.0:1789297137.266413:0:5822:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:3.0:1789297137.266421:0:5822:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:3.0:1789297137.266606:0:5822:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789297137.266659:0:5822:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20065 00000020:01000004:3.0:1789297137.266664:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789297137.266666:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789297137.266672:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297137.266673:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297137.266674:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297137.266675:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297137.266676:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789297137.266677:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789297137.266684:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789297137.266686:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789297137.266688:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297137.266689:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789297137.266692:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:3.0:1789297137.266694:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789297137.266695:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789297137.266696:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297137.266697:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297137.266698:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297137.266699:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297137.266700:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789297137.266701:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789297137.267051:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789297137.267052:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789297137.267053:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297137.267053:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789297137.267090:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789297137.267113:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132544:0@lo:253: 00000100:00100000:3.0:1789297137.267228:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.267283:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000009a1c7a8c going to sleep for 11 seconds 00000100:00100000:0.0:1789297137.267343:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957132544 00000100:00100000:0.0:1789297137.267351:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957132544 00000100:00100000:0.0:1789297137.267412:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297137.267426:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000110ebb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:5822:x1876213957132544:12345-0@lo:253: 20000000:01000000:0.0:1789297137.267498:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789297137.267502:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:1.0:1789297137.267825:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1789297137.267896:0:5837:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:0.0:1789297137.268266:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789297137.269125:0:5859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:0.0:1789297137.269421:0:5837:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1789297137.269426:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:0.0:1789297137.269431:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:0.0:1789297137.269434:0:5837:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:0.0:1789297137.269451:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:0.0:1789297137.269652:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297137.269922:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:0.0:1789297137.269936:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789297137.269980:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:0.0:1789297137.270029:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:0.0:1789297137.270061:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:0.0:1789297137.270151:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:0.0:1789297137.270164:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:0.0:1789297137.270207:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:0.0:1789297137.270214:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:0.0:1789297137.270245:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:0.0:1789297137.270252:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:0.0:1789297137.270276:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:0.0:1789297137.270312:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:0.0:1789297137.270335:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:0.0:1789297137.270339:0:5837:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:0.0:1789297137.270348:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297137.270565:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:0.0:1789297137.270605:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789297137.270635:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:0.0:1789297137.270661:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:0.0:1789297137.270697:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:0.0:1789297137.270770:0:5837:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:0.0:1789297137.270835:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:0.0:1789297137.270851:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789297137.270915:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:0.0:1789297137.270952:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:0.0:1789297137.271001:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:0.0:1789297137.271012:0:5837:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:0.0:1789297137.271079:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:0.0:1789297137.271086:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:0.0:1789297137.271111:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:0.0:1789297137.271145:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:0.0:1789297137.271284:0:5837:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:0.0:1789297137.271320:0:5837:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:0.0:1789297137.271327:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:1.0:1789297137.272128:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:0.0:1789297137.272390:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:0.0:1789297137.272412:0:5837:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.202.143@tcp for mdt 20000000:01000000:0.0:1789297137.272414:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789297137.272441:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:0.0:1789297137.272448:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:0.0:1789297137.272472:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:0.0:1789297137.272478:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:0.0:1789297137.272511:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:0.0:1789297137.272520:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:0.0:1789297137.272545:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:0.0:1789297137.272590:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:0.0:1789297137.272640:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789297137.272643:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:0.0:1789297137.272649:0:5837:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:0.0:1789297137.272655:0:5837:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:3.0:1789297137.273147:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 20000000:02000000:0.0:1789297137.273276:0:5837:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:0.0:1789297137.279040:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:0.0:1789297137.279106:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 160 off10176 00000040:00080000:0.0:1789297137.279224:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10400 20000000:01000000:0.0:1789297137.279245:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789297137.279254:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789297137.279259:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789297137.279275:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789297137.279278:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789297137.279387:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789297137.279390:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:2.0:1789297137.279899:0:5862:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:1.0:1789297137.280694:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:1.0:1789297137.280780:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:1.0:1789297137.280808:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 20000000:01000000:1.0:1789297137.280821:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789297137.280823:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789297137.281624:0:5863:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 00000040:00080000:1.0:1789297137.281982:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10624 00000040:00080000:1.0:1789297137.282039:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 80 off10704 00000040:00080000:1.0:1789297137.282100:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 00000020:00000080:1.0:1789297137.282114:0:5837:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1789297137.282116:0:5837:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 10000000:01000000:1.0:1789297137.282124:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789297137.282153:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282179:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282190:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282197:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282215:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282221:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282227:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000fc84eb0a already unused, calling callback (00000000e84b1d5c) 00010000:00010000:1.0:1789297137.282231:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282239:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282253:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282261:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297137.282266:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b117 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1789297137.282288:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1789297137.567177:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000110ebb11 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:5822:x1876213957132544:12345-0@lo:253: Request processed in 299751us (299943us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297137.567194:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297137.567320:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132544:0@lo:253: 10000000:01000000:3.0:1789297137.567338:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789297137.567341:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789297137.567342:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789297137.567344:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297137.567345:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:3.0:1789297137.567346:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297137.567347:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297137.567362:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789297137.567364:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789297137.567365:0:5822:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:3.0:1789297137.567367:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297137.567368:0:5822:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1789297137.567387:0:5822:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000e87995bb from lustre-MDT0000 10000000:01000000:3.0:1789297137.567415:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:3.0:1789297137.567419:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789297137.567423:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff982b18368000 10000000:01000000:3.0:1789297137.567426:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789297137.567434:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982b18368000 from 1 10000000:01000000:3.0:1789297137.567437:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789297137.567481:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 0000000062f7a5aa/0x8ad177e823a0b11e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.567492:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 0000000062f7a5aa/0x8ad177e823a0b11e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.567501:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 0000000062f7a5aa/0x8ad177e823a0b11e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297137.567520:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132672:0@lo:101: 00000100:00100000:3.0:1789297137.567569:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.567629:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0349104 going to sleep for 11 seconds 00000100:00100000:0.0:1789297137.567795:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957132672 00000100:00100000:0.0:1789297137.567803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957132672 00000100:00100000:0.0:1789297137.567854:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789297137.567863:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000009b383983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:5822:x1876213957132672:12345-0@lo:101: 00010000:00010000:0.0:1789297137.567877:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297137.567891:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c27b9d55/0x8ad177e823a0b125 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b11e expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.567922:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c27b9d55/0x8ad177e823a0b125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.567935:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c27b9d55/0x8ad177e823a0b125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 6 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.567946:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c27b9d55, rc 0) 00000100:00100000:0.0:1789297137.567984:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000009b383983 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+6:5822:x1876213957132672:12345-0@lo:101: Request processed in 123us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297137.567991:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297137.568178:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132672:0@lo:101: 00010000:00010000:3.0:1789297137.568192:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 0000000062f7a5aa/0x8ad177e823a0b11e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.568201:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 0000000062f7a5aa/0x8ad177e823a0b11e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297137.568253:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132800:0@lo:501: 00000100:00100000:3.0:1789297137.568290:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.568325:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0349104 going to sleep for 11 seconds 00000100:00100000:0.0:1789297137.568411:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957132800 00000100:00100000:0.0:1789297137.568415:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957132800 00000100:00100000:0.0:1789297137.568449:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789297137.568456:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fc9246b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+6:5822:x1876213957132800:12345-0@lo:501: 00000100:00100000:0.0:1789297137.568834:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fc9246b3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+6:5822:x1876213957132800:12345-0@lo:501: Request processed in 378us (543us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789297137.568842:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297137.568916:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132800:0@lo:501: 10000000:01000000:3.0:1789297137.568941:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1789297137.568958:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 0000000062f7a5aa/0x8ad177e823a0b11e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.568965:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 0000000062f7a5aa/0x8ad177e823a0b11e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297137.568974:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982b07359800 10000000:01000000:3.0:1789297137.568977:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789297137.568981:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff982b07359800 10000000:01000000:3.0:1789297137.568983:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1789297137.568986:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff982b07359800 from 1 10000000:01000000:3.0:1789297137.568988:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1789297137.569005:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 0000000002be42f2/0x8ad177e823a0b12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.569012:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 0000000002be42f2/0x8ad177e823a0b12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.569019:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 0000000002be42f2/0x8ad177e823a0b12c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297137.569031:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132928:0@lo:101: 00000100:00100000:3.0:1789297137.569057:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.569086:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0349104 going to sleep for 11 seconds 00000100:00100000:0.0:1789297137.569183:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957132928 00000100:00100000:0.0:1789297137.569188:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957132928 00000100:00100000:0.0:1789297137.569219:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789297137.569226:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d45585ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+6:5822:x1876213957132928:12345-0@lo:101: 00010000:00010000:0.0:1789297137.569234:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297137.569244:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000619ad563/0x8ad177e823a0b133 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b12c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.569259:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000619ad563/0x8ad177e823a0b133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b12c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.569268:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000619ad563/0x8ad177e823a0b133 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b12c expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.569275:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000619ad563, rc 0) 00000100:00100000:0.0:1789297137.569314:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d45585ae pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+7:5822:x1876213957132928:12345-0@lo:101: Request processed in 89us (257us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297137.569320:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789297137.569534:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957132928:0@lo:101: 00010000:00010000:3.0:1789297137.569554:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 0000000002be42f2/0x8ad177e823a0b12c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.569561:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 0000000002be42f2/0x8ad177e823a0b12c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297137.569572:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1789297137.569624:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 0000000002be42f2/0x8ad177e823a0b12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.569631:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 0000000002be42f2/0x8ad177e823a0b12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297137.569637:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1789297137.569641:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789297137.569645:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff982b07359800 10000000:01000000:3.0:1789297137.569647:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1789297137.569650:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1789297137.569652:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1789297137.569667:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000a15012af/0x8ad177e823a0b13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.569674:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000a15012af/0x8ad177e823a0b13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.569681:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000a15012af/0x8ad177e823a0b13a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297137.569693:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133056:0@lo:101: 00000100:00100000:3.0:1789297137.569762:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.569786:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0349104 going to sleep for 11 seconds 00000100:00100000:0.0:1789297137.569842:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133056 00000100:00100000:0.0:1789297137.569847:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133056 00000100:00100000:0.0:1789297137.569882:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789297137.569889:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000159d979f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+7:5822:x1876213957133056:12345-0@lo:101: 00010000:00010000:0.0:1789297137.569897:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297137.569904:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000001271bec2/0x8ad177e823a0b141 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b13a expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.569929:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000001271bec2/0x8ad177e823a0b141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.569937:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000001271bec2/0x8ad177e823a0b141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 8 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297137.569946:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000001271bec2, rc 0) 00000100:00100000:0.0:1789297137.569974:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000159d979f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+8:5822:x1876213957133056:12345-0@lo:101: Request processed in 86us (212us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297137.569980:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789297137.570061:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133056:0@lo:101: 00010000:00010000:3.0:1789297137.570073:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000a15012af/0x8ad177e823a0b13a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297137.570080:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000a15012af/0x8ad177e823a0b13a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297137.570119:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133184:0@lo:501: 00000100:00100000:3.0:1789297137.570143:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.570166:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0349104 going to sleep for 11 seconds 00000100:00100000:0.0:1789297137.570216:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133184 00000100:00100000:0.0:1789297137.570220:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133184 00000100:00100000:0.0:1789297137.570243:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789297137.570249:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000085459665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+8:5822:x1876213957133184:12345-0@lo:501: 00000100:00100000:0.0:1789297137.570467:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000085459665 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:5822:x1876213957133184:12345-0@lo:501: Request processed in 217us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297137.570611:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133184:0@lo:501: 00000100:00100000:3.0:1789297137.570638:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133312:0@lo:503: 00000100:00100000:3.0:1789297137.570673:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.570687:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b0349104 going to sleep for 11 seconds 00000100:00100000:3.0:1789297137.570737:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133312 00000100:00100000:3.0:1789297137.570741:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133312 00000100:00100000:3.0:1789297137.570761:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297137.570766:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000fe3dbfe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5822:x1876213957133312:12345-0@lo:503: 00000100:00100000:3.0:1789297137.570909:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000fe3dbfe6 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5822:x1876213957133312:12345-0@lo:503: Request processed in 142us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297137.570916:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297137.570949:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133312:0@lo:503: 00000100:00100000:3.0:1789297137.571133:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5865:1876213957133440:0@lo:502: 00000100:00100000:3.0:1789297137.571168:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297137.571186:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133440 00000100:00100000:3.0:1789297137.571195:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133440 00000100:00100000:3.0:1789297137.571213:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789297137.571218:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004ef11f53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5865:x1876213957133440:12345-0@lo:502: 00000100:00100000:3.0:1789297137.571350:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004ef11f53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5865:x1876213957133440:12345-0@lo:502: Request processed in 133us (183us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297137.571357:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789297137.571388:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 000000002af8a016 going to sleep for 11 seconds 00000100:00100000:3.0:1789297137.571400:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5865:1876213957133440:0@lo:502: 00000020:01000000:3.0:1789297137.571421:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789297137.571432:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297137.571435:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789297137.571440:0:5865:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:3.0:1789297137.571442:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789297137.571456:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (000000007c8a33af) 00000020:00000080:3.0:1789297137.571581:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:3.0:1789297137.571590:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:3.0:1789297137.571655:0:5865:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:3.0:1789297137.571678:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0b14f 00000020:00000080:3.0:1789297137.571971:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:3.0:1789297137.571977:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789297137.571981:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297137.571983:0:5865:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:3.0:1789297137.571985:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789297137.571989:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297137.571990:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:3.0:1789297137.571993:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789297137.572001:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (0000000027ec84df) 00000020:00000080:3.0:1789297137.572011:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:3.0:1789297137.572015:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:3.0:1789297137.572017:0:5865:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:3.0:1789297137.572019:0:5865:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:3.0:1789297137.572032:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789297137.572077:0:5865:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e87995bb from lustre-MDT0000, refs=3 00000020:00000080:3.0:1789297137.572096:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (000000000e060303) 00000020:00000080:3.0:1789297137.572104:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:3.0:1789297137.572155:0:5865:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:3.0:1789297137.572161:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0b164 00000020:00000080:3.0:1789297137.572267:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:3.0:1789297137.572274:0:5865:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:3.0:1789297137.572278:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8ad177e823a0b16b 00080000:01000000:3.0:1789297137.572283:0:5865:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:3.0:1789297137.572286:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0b172 00000100:00100000:0.0:1789297137.572402:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00080000:10000000:3.0:1789297137.573131:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:3.0:1789297137.574186:0:5865:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:3.0:1789297137.578217:0:5865:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:0.0:1789297137.693421:0:5865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:0.0:1789297137.693980:0:5865:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:0.0:1789297137.695952:0:5865:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:0.0:1789297137.696175:0:5865:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:3.0:1789297137.734650:0:5865:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (00000000357baabf) 00000020:00000080:3.0:1789297137.734678:0:5865:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:3.0:1789297137.734824:0:5865:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:3.0:1789297137.734832:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0b180 00000020:00000080:0.0:1789297137.741670:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:1.0:1789297137.754110:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297137.818152:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297137.850908:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1789297137.906385:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297138.012603:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297138.086507:0:5865:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00010000:00010000:3.0:1789297138.110300:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789297138.128511:0:5865:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8ad177e823a0b187 00000020:00000080:3.0:1789297138.129206:0:5865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:3.0:1789297138.129219:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789297138.129226:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297138.129229:0:5865:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:3.0:1789297138.129232:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789297138.129239:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297138.129240:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:3.0:1789297138.129245:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:3.0:1789297138.129324:0:5865:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:3.0:1789297138.129342:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789297138.129346:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297138.129347:0:5865:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:3.0:1789297138.129350:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789297138.129353:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297138.129354:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789297138.129357:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789297138.129359:0:5865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1789297138.129406:0:5865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5865:1876213957133568:0@lo:502: 00000100:00100000:3.0:1789297138.129489:0:5865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297138.129555:0:5865:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edbd00f9 going to sleep for 11 seconds 00000100:00100000:1.0:1789297138.129734:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133568 00000100:00100000:1.0:1789297138.129743:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133568 00000100:00100000:1.0:1789297138.129803:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789297138.129811:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000019492b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:5865:x1876213957133568:12345-0@lo:502: 00000100:00100000:1.0:1789297138.130032:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000019492b87 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:5865:x1876213957133568:12345-0@lo:502: Request processed in 223us (544us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297138.130045:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789297138.130091:0:5865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005650c66e pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5865:1876213957133568:0@lo:502: 00000020:01000000:1.0:1789297138.130115:0:5865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297138.130120:0:5865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297138.130122:0:5865:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre sys.timeout 00000040:00080000:1.0:1789297138.130128:0:5865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1789297138.130614:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1789297138.130633:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789297138.130652:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000a15012af/0x8ad177e823a0b13a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.130662:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000a15012af/0x8ad177e823a0b13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297138.130670:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b07359800 from 1 10000000:01000000:3.0:1789297138.130673:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789297138.130735:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.130742:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.130751:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297138.130779:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000695b927e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133696:0@lo:101: 00000100:00100000:3.0:1789297138.130817:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297138.130844:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a86d2db6 going to sleep for 11 seconds 00000100:00100000:3.0:1789297138.130860:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133696 00000100:00100000:3.0:1789297138.130865:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133696 00000100:00100000:3.0:1789297138.130887:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789297138.130893:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000975761e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:5822:x1876213957133696:12345-0@lo:101: 00010000:00010000:3.0:1789297138.130902:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297138.130913:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b18e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.130931:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.130940:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.130948:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000000c1e6216, rc 0) 00000100:00100000:3.0:1789297138.130972:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000975761e3 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5822:x1876213957133696:12345-0@lo:101: Request processed in 80us (156us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297138.130978:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789297138.131005:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000695b927e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133696:0@lo:101: 00010000:00010000:3.0:1789297138.131013:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.131021:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297138.131862:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000695b927e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133824:0@lo:256: 00000100:00100000:3.0:1789297138.131908:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297138.131974:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a86d2db6 going to sleep for 11 seconds 00000100:00100000:2.0:1789297138.132100:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133824 00000100:00100000:2.0:1789297138.132106:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133824 00000100:00100000:2.0:1789297138.132161:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789297138.132167:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000c2726664 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5822:x1876213957133824:12345-0@lo:256: 20000000:01000000:2.0:1789297138.132190:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1789297138.132195:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1789297138.132260:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000c2726664 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5822:x1876213957133824:12345-0@lo:256: Request processed in 93us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297138.132266:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1789297138.132393:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000695b927e pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133824:0@lo:256: 10000000:01000000:0.0:1789297138.133155:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789297138.133181:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.133207:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297138.133217:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b07359800 from 1 10000000:01000000:0.0:1789297138.133220:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789297138.133269:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.133276:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.133285:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297138.133312:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133952:0@lo:101: 00000100:00100000:0.0:1789297138.133357:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297138.133375:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aae74a1 going to sleep for 11 seconds 00000100:00100000:1.0:1789297138.133720:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957133952 00000100:00100000:1.0:1789297138.133726:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957133952 00000100:00100000:1.0:1789297138.133759:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297138.133766:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003ea4182c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:5822:x1876213957133952:12345-0@lo:101: 00010000:00010000:1.0:1789297138.133777:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297138.133790:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b19c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.133812:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.133820:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.133827:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000fc84eb0a, rc 0) 00000100:00100000:1.0:1789297138.133861:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003ea4182c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5822:x1876213957133952:12345-0@lo:101: Request processed in 96us (504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297138.133867:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1789297138.134013:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957133952:0@lo:101: 00010000:00010000:0.0:1789297138.134024:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.134033:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297138.134085:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134080:0@lo:501: 00000100:00100000:0.0:1789297138.134109:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297138.134141:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aae74a1 going to sleep for 11 seconds 00000100:00100000:1.0:1789297138.134250:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134080 00000100:00100000:1.0:1789297138.134254:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134080 00000100:00100000:2.0:1789297138.134406:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789297138.134415:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b86d9d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5822:x1876213957134080:12345-0@lo:501: 00000100:00100000:2.0:1789297138.134854:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b86d9d82 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5822:x1876213957134080:12345-0@lo:501: Request processed in 441us (744us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297138.134863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789297138.135080:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134080:0@lo:501: 00000100:00100000:0.0:1789297138.135111:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134208:0@lo:503: 00000100:00100000:0.0:1789297138.135149:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297138.135188:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 000000006aae74a1 going to sleep for 11 seconds 00000100:00100000:2.0:1789297138.135447:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134208 00000100:00100000:2.0:1789297138.135453:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134208 00000100:00100000:2.0:1789297138.135484:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789297138.135491:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000788f9660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5822:x1876213957134208:12345-0@lo:503: 00000040:00080000:2.0:1789297138.135525:0:5836:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789297138.135566:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000788f9660 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5822:x1876213957134208:12345-0@lo:503: Request processed in 76us (417us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297138.135573:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789297138.135684:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134208:0@lo:503: 00000040:00080000:0.0:1789297138.137106:0:5869:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:2.0:1789297138.137482:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:2.0:1789297138.137505:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789297138.137525:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297138.137538:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297138.137583:0:5822:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789297138.137586:0:5822:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982b07359800 10000000:01000000:2.0:1789297138.137589:0:5822:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982b07359800 10000000:01000000:2.0:1789297138.137593:0:5822:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789297138.137598:0:5822:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b07359800 from 1 10000000:01000000:2.0:1789297138.137601:0:5822:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789297138.137651:0:5822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 00000000bf6e9536/0x8ad177e823a0b1aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297138.137659:0:5822:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 00000000bf6e9536/0x8ad177e823a0b1aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297138.137669:0:5822:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 00000000bf6e9536/0x8ad177e823a0b1aa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297138.137730:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000423b2bb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134336:0@lo:101: 00000100:00100000:2.0:1789297138.137790:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297138.137829:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 0000000081f22406 going to sleep for 11 seconds 00000100:00100000:0.0:1789297138.137931:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134336 00000100:00100000:0.0:1789297138.137938:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134336 00000100:00100000:0.0:1789297138.137983:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789297138.137990:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000543dbf29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5822:x1876213957134336:12345-0@lo:101: 00010000:00010000:0.0:1789297138.138002:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297138.138013:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000003586e549/0x8ad177e823a0b1b1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b1aa expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.138034:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000003586e549/0x8ad177e823a0b1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.138043:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000003586e549/0x8ad177e823a0b1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.138050:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000003586e549, rc 0) 00000100:00100000:0.0:1789297138.138094:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000543dbf29 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5822:x1876213957134336:12345-0@lo:101: Request processed in 104us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297138.138101:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789297138.138175:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000423b2bb4 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134336:0@lo:101: 00010000:00010000:3.0:1789297138.138200:0:5822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 00000000bf6e9536/0x8ad177e823a0b1aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.138208:0:5822:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 00000000bf6e9536/0x8ad177e823a0b1aa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297138.138256:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8eef16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134464:0@lo:501: 00000100:00100000:3.0:1789297138.138302:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297138.138324:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a86d2db6 going to sleep for 11 seconds 00000100:00100000:0.0:1789297138.138476:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134464 00000100:00100000:0.0:1789297138.138481:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134464 00000100:00100000:0.0:1789297138.138515:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789297138.138522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000734d6909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5822:x1876213957134464:12345-0@lo:501: 00000100:00100000:0.0:1789297138.138808:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000734d6909 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5822:x1876213957134464:12345-0@lo:501: Request processed in 287us (506us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297138.138815:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789297138.138952:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8eef16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134464:0@lo:501: 00000100:00100000:3.0:1789297138.138983:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8eef16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134592:0@lo:503: 00000100:00100000:3.0:1789297138.139020:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297138.139040:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a86d2db6 going to sleep for 11 seconds 00000100:00100000:0.0:1789297138.139141:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134592 00000100:00100000:0.0:1789297138.139145:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134592 00000100:00100000:0.0:1789297138.139183:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789297138.139190:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005843aa0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5822:x1876213957134592:12345-0@lo:503: 00000100:00100000:0.0:1789297138.139539:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005843aa0d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5822:x1876213957134592:12345-0@lo:503: Request processed in 350us (519us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297138.139547:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789297138.139623:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8eef16a pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957134592:0@lo:503: 00000100:00100000:3.0:1789297138.140006:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000e8eef16a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5870:1876213957134720:0@lo:502: 00000100:00100000:3.0:1789297138.140041:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297138.140064:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000edbd00f9 going to sleep for 11 seconds 00000100:00100000:0.0:1789297138.140104:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134720 00000100:00100000:0.0:1789297138.140109:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134720 00000100:00100000:0.0:1789297138.140141:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789297138.140148:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ea0444fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5870:x1876213957134720:12345-0@lo:502: 00000100:00100000:0.0:1789297138.140581:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ea0444fc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5870:x1876213957134720:12345-0@lo:502: Request processed in 433us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297138.140589:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789297138.140657:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000e8eef16a pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5870:1876213957134720:0@lo:502: 00000020:01000004:3.0:1789297138.140751:0:5870:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:3.0:1789297138.140766:0:5870:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000aec60704) 00000020:00000080:3.0:1789297138.140793:0:5870:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:3.0:1789297138.140862:0:5870:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000e87995bb from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789297138.140866:0:5870:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000e87995bb from lustre-MDT0000, refs=4 00000020:01000004:3.0:1789297138.140869:0:5870:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000e87995bb 4 00010000:00080000:3.0:1789297138.140898:0:5870:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000067fcc729@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789297138.144092:0:5870:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1789297138.145583:0:5870:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789297138.145635:0:5870:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789297138.145648:0:5870:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8ad177e823a0b1bf 00000100:00080000:2.0:1789297138.145659:0:5870:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789297138.145668:0:5870:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067fcc729 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789297138.145724:0:5870:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@00000000d1129897 x1876213957134848/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789297138.145814:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d1129897 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957134848:0@lo:38: 00000100:00100000:3.0:1789297138.145879:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789297138.146112:0:5870:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789297138.146421:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134848 00000100:00100000:1.0:1789297138.146430:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134848 00000100:00100000:1.0:1789297138.146461:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789297138.146473:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e8eef16a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876213957134848:12345-0@lo:38: 00000100:00100000:1.0:1789297138.152528:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e8eef16a pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876213957134848:12345-0@lo:38: Request processed in 6038us (6633us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789297138.152543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297138.156748:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789297138.156763:0:3301:0:(import.c:65:import_set_state_nolock()) 0000000067fcc729 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789297138.156771:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:3.0:1789297138.156775:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d1129897 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957134848:0@lo:38: 00000100:00100000:0.0:1789297138.157013:0:5870:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5870:1876213957134976:0@lo:502: 00000100:00100000:0.0:1789297138.157094:0:5870:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297138.157139:0:5870:0:(client.c:2715:ptlrpc_set_wait()) set 00000000f6ac470b going to sleep for 11 seconds 00000100:00100000:1.0:1789297138.157254:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957134976 00000100:00100000:1.0:1789297138.157261:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957134976 00000100:00100000:1.0:1789297138.157326:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789297138.157334:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000005ef208bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5870:x1876213957134976:12345-0@lo:502: 00000100:00100000:1.0:1789297138.157795:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000005ef208bb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5870:x1876213957134976:12345-0@lo:502: Request processed in 462us (701us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297138.157804:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789297138.157852:0:5870:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003d995c95 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5870:1876213957134976:0@lo:502: 00000040:00080000:1.0:1789297138.158013:0:5870:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000020:01000000:0.0:1789297138.158823:0:5822:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:0.0:1789297138.158847:0:5822:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789297138.158863:0:5822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 00000000bf6e9536/0x8ad177e823a0b1aa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.158875:0:5822:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 00000000bf6e9536/0x8ad177e823a0b1aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789297138.158956:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789297138.158959:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789297138.158961:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297138.158962:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297138.158963:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297138.158964:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297138.158965:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789297138.158967:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789297138.158968:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789297138.158969:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789297138.158971:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297138.158972:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789297138.158976:0:5822:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:0.0:1789297138.158979:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789297138.158980:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789297138.158982:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297138.158983:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297138.158983:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297138.158985:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297138.158986:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789297138.158986:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789297138.158987:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1789297138.158988:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1789297138.158989:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297138.158990:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789297138.159014:0:5822:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1789297138.159029:0:5822:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bccf7fc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957135104:0@lo:253: 00000100:00100000:0.0:1789297138.159077:0:5822:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297138.159113:0:5822:0:(client.c:2715:ptlrpc_set_wait()) set 00000000938bad6a going to sleep for 11 seconds 00000100:00100000:2.0:1789297138.159428:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957135104 00000100:00100000:2.0:1789297138.159437:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957135104 00000100:00100000:2.0:1789297138.159620:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789297138.159628:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000001a812978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5822:x1876213957135104:12345-0@lo:253: 20000000:01000000:2.0:1789297138.159663:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:2.0:1789297138.159675:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1789297138.198187:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789297138.198211:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789297138.198265:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789297138.198272:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789297138.198315:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297138.198337:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297138.198344:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297138.198383:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297138.198397:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 12 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297138.198412:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000547b5ddf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876213957135232:0@lo:104: 00000100:00100000:2.0:1789297138.198552:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297138.198611:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c65fc6d3 going to sleep for 11 seconds 00000100:00100000:0.0:1789297138.198887:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957135232 00000100:00100000:0.0:1789297138.198896:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957135232 00000100:00100000:0.0:1789297138.198949:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789297138.198957:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000693c7731 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5858:x1876213957135232:12345-0@lo:104: 00010000:00010000:0.0:1789297138.198975:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297138.199028:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789297138.199034:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000693c7731 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5858:x1876213957135232:12345-0@lo:104: Request processed in 78us (482us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297138.199041:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297138.199824:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000547b5ddf pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876213957135232:0@lo:104: 00010000:00010000:2.0:1789297138.199847:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.201054:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297138.201062:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.201073:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000001b61ee3a already unused, calling callback (00000000f6e4c643) 10000000:00010000:1.0:1789297138.201076:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.201085:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297138.201091:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297138.201096:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789297138.201159:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.201170:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297138.201195:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.201200:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 000000001b61ee3a/0x8ad177e823a0b18e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b195 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297138.201224:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297138.201226:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297138.201227:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297138.201334:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297138.201348:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c206f396 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957135360:0@lo:103: 00000100:00100000:1.0:1789297138.201404:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297138.201756:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957135360 00000100:00100000:3.0:1789297138.201763:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957135360 00010000:00010000:3.0:1789297138.201788:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 13 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297138.201818:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297138.201825:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f4c996ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:3302:x1876213957135360:12345-0@lo:103: 00010000:00010000:3.0:1789297138.201836:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297138.201840:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 13 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201849:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 13 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201861:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000000c1e6216/0x8ad177e823a0b195 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b18e expref: 13 pid: 5837 timeout: 300 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201874:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201890:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1789297138.201902:0:5826:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003632614s 00010000:00010000:3.0:1789297138.201906:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201912:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201917:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201921:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201925:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 000000006b910c31 already unused, calling callback (00000000e84b1d5c) 00010000:00010000:3.0:1789297138.201928:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201934:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201947:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.201956:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297138.201989:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f4c996ac pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3302:x1876213957135360:12345-0@lo:103: Request processed in 165us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297138.201995:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297138.202036:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c206f396 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957135360:0@lo:103: 00010000:00010000:3.0:1789297138.202057:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.202065:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297138.202070:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 000000006b910c31/0x8ad177e823a0b1c6 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297138.214049:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000001a812978 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5822:x1876213957135104:12345-0@lo:253: Request processed in 54412us (54962us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297138.214067:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789297138.214509:0:5822:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bccf7fc5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5822:1876213957135104:0@lo:253: 10000000:01000000:2.0:1789297138.214522:0:5822:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1789297138.214524:0:5822:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789297138.214526:0:5822:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1789297138.214527:0:5822:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789297138.214528:0:5822:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789297138.214529:0:5822:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789297138.214529:0:5822:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789297138.214530:0:5822:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1789297138.214531:0:5822:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1789297138.214532:0:5822:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789297138.214533:0:5822:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789297138.214533:0:5822:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789297138.214534:0:5822:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1789297138.214545:0:5822:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789297138.227055:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297138.227625:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789297138.228078:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297138.228562:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789297138.228918:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297138.229084:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1789297138.230198:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297138.230656:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1789297138.230967:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297138.231137:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1789297138.231597:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297138.231829:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:3.0:1789297138.288399:0:5822:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:0.0:1789297138.367852:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:1.0:1789297138.370596:0:5876:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789297138.374157:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1789297138.374577:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1789297138.379321:0:5875:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:3.0:1789297138.379332:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000004:00000080:0.0:1789297138.379667:0:5822:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1789297138.379766:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1789297138.387827:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297138.396790:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1789297138.397400:0:5822:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1789297138.397434:0:5822:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:0.0:1789297138.397776:0:5822:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:0.0:1789297138.398194:0:5822:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:0.0:1789297138.413652:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:0.0:1789297138.413851:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:0.0:1789297138.418595:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:0.0:1789297138.418932:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:0.0:1789297138.422402:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:0.0:1789297138.422665:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:0.0:1789297138.423269:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:0.0:1789297138.423430:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:0.0:1789297138.423590:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:0.0:1789297138.423778:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:0.0:1789297138.423928:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:0.0:1789297138.424073:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:0.0:1789297138.424206:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:0.0:1789297138.424344:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:0.0:1789297138.424503:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:0.0:1789297138.424640:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:0.0:1789297138.431006:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:0.0:1789297138.431154:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:0.0:1789297138.434965:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:0.0:1789297138.435223:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:1.0:1789297138.439082:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:1.0:1789297138.439271:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:1.0:1789297138.439433:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:1.0:1789297138.439593:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:1.0:1789297138.439788:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:1.0:1789297138.439953:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:1.0:1789297138.440091:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:1.0:1789297138.440224:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:1.0:1789297138.440361:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:1.0:1789297138.440516:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:1.0:1789297138.440647:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:1.0:1789297138.440825:0:5822:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:1.0:1789297138.441020:0:5822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:2.0:1789297138.452362:0:5876:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1789297138.555878:0:5822:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1789297138.555922:0:5822:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb286c1c57988 00100000:10000000:2.0:1789297138.555932:0:5822:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:3.0:1789297138.560770:0:5822:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789297138.560789:0:5822:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789297138.560802:0:5822:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1789297138.560828:0:5822:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00000040:00080000:3.0:1789297138.711821:0:5876:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1789297138.711901:0:5876:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1789297138.711905:0:5876:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00010000:00010000:3.0:1789297139.133166:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297140.156887:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297141.180866:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297142.208980:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297143.228890:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297143.231596:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000364b4a81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957135488:0@lo:400: 00000100:00100000:1.0:1789297143.231701:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297143.231836:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957135488 00000100:00100000:3.0:1789297143.231845:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957135488 00000100:00100000:3.0:1789297143.231899:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789297143.231907:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000106ecb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:3304:x1876213957135488:12345-0@lo:400: 00000100:00080000:0.0:1789297143.231992:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789297143.232004:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789297143.232008:0:37:0:(import.c:65:import_set_state_nolock()) 0000000067fcc729 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789297143.232015:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000067fcc729 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789297143.232040:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000042c58738 x1876213957135616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789297143.238760:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000106ecb53 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:3304:x1876213957135488:12345-0@lo:400: Request processed in 6844us (7050us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297143.238780:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1789297143.238874:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000042c58738 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957135616:0@lo:38: 00000100:00100000:3.0:1789297143.238935:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297143.239066:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957135616 00000100:00100000:0.0:1789297143.239076:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957135616 00000100:00100000:0.0:1789297143.239117:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297143.239122:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000995e93ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876213957135616:12345-0@lo:38: 00010000:00080000:0.0:1789297143.239150:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 155 last 0 00000020:00000080:0.0:1789297143.239188:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8ad177e823a0b1cd 00000004:00100000:0.0:1789297143.239235:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789297143.239376:0:5844:0:(import.c:65:import_set_state_nolock()) 000000002cf84469 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789297143.239434:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000995e93ae pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876213957135616:12345-0@lo:38: Request processed in 310us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297143.239441:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789297143.239529:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000042c58738 x1876213957135616/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789297153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789297143.239544:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789297143.239552:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1789297143.239558:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789297143.239560:0:3301:0:(import.c:65:import_set_state_nolock()) 0000000067fcc729 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789297143.239565:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000042c58738 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957135616:0@lo:38: 00000100:00100000:1.0:1789297143.239736:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000364b4a81 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957135488:0@lo:400: 10000000:01000000:3.0:1789297143.741404:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789297143.741413:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b07359800 from 3 10000000:01000000:3.0:1789297143.741419:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789297143.741467:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000000c1e6216/0x8ad177e823a0b1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297143.741480:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000000c1e6216/0x8ad177e823a0b1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297143.741491:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000000c1e6216/0x8ad177e823a0b1d4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297143.741516:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000099ce2aa7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957135744:0@lo:101: 00000100:00100000:3.0:1789297143.742210:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297143.742848:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000000bb407de going to sleep for 11 seconds 00000100:00100000:0.0:1789297143.744352:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957135744 00000100:00100000:0.0:1789297143.744368:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957135744 00000100:00100000:0.0:1789297143.744423:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789297143.744432:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000577e89ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5839:x1876213957135744:12345-0@lo:101: 00010000:00010000:0.0:1789297143.744451:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297143.744469:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000005761c67/0x8ad177e823a0b1db lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b1d4 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297143.744500:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000005761c67/0x8ad177e823a0b1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297143.744523:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000005761c67/0x8ad177e823a0b1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297143.744532:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000005761c67, rc 0) 00000100:00100000:0.0:1789297143.746336:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000577e89ec pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957135744:12345-0@lo:101: Request processed in 1897us (4121us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297143.746349:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789297143.746433:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000099ce2aa7 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957135744:0@lo:101: 00010000:00010000:0.0:1789297143.746455:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000000c1e6216/0x8ad177e823a0b1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297143.746465:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000000c1e6216/0x8ad177e823a0b1d4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297143.746538:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ace27880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957135872:0@lo:256: 00000100:00100000:0.0:1789297143.746587:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297143.746620:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 00000000bea67b45 going to sleep for 11 seconds 00000100:00100000:0.0:1789297143.746638:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957135872 00000100:00100000:0.0:1789297143.746654:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957135872 00000100:00100000:0.0:1789297143.747807:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789297143.747817:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f1586971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957135872:12345-0@lo:256: 20000000:01000000:0.0:1789297143.747843:0:5836:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789297143.747860:0:5836:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789297143.747862:0:5836:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:0.0:1789297143.747969:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f1586971 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957135872:12345-0@lo:256: Request processed in 152us (1380us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297143.747976:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789297143.748040:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ace27880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957135872:0@lo:256: 10000000:01000000:0.0:1789297143.748088:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1789297143.748095:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: 000000000c1e6216/0x8ad177e823a0b1d4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297143.748105:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: 000000000c1e6216/0x8ad177e823a0b1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:02000400:2.0:1789297143.832261:0:6118:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1789297144.254338:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297145.277727:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297146.302884:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297147.329796:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297148.349033:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297148.349661:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297148.349686:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000004f1380f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957136000:0@lo:400: 00000100:00100000:1.0:1789297148.349812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297148.350016:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136000 00000100:00100000:3.0:1789297148.350025:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136000 00000100:00100000:3.0:1789297148.350080:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789297148.350100:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d27c1fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3304:x1876213957136000:12345-0@lo:400: 00000100:00100000:3.0:1789297148.350163:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d27c1fbc pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3304:x1876213957136000:12345-0@lo:400: Request processed in 54us (341us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297148.350170:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789297148.350215:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000004f1380f5 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957136000:0@lo:400: 00000100:00100000:2.0:1789297148.350353:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005fa17db4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957136128:0@lo:400: 00000100:00100000:2.0:1789297148.350458:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297148.350539:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136128 00000100:00100000:1.0:1789297148.350544:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136128 00000100:00100000:1.0:1789297148.350576:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789297148.350582:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000547b5ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957136128:12345-0@lo:400: 00000100:00100000:1.0:1789297148.350639:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000547b5ddf pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957136128:12345-0@lo:400: Request processed in 54us (178us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297148.350645:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1789297148.351140:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000005fa17db4 x1876213957136128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297164 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297148.351206:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005fa17db4 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957136128:0@lo:400: 00000020:00000080:0.0:1789297149.230515:0:6320:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffec80e6580 20000000:00000080:0.0:1789297149.230540:0:6320:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982b39ae6800 uarg=0000000000000000 20000000:01000000:0.0:1789297149.230577:0:6320:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1789297149.230583:0:6320:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1789297149.230589:0:6320:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1789297149.231108:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1789297149.231123:0:6320:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:0.0:1789297149.238665:0:6320:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297149.239126:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:0.0:1789297149.239210:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:0.0:1789297149.239266:0:6320:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:0.0:1789297149.239290:0:6320:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789297149.239312:0:6320:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297149.239333:0:6320:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297149.239341:0:6320:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297149.239394:0:6320:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297149.239421:0:6320:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 11 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297149.239436:0:6320:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ace27880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1876213957136256:0@lo:104: 00000100:00100000:0.0:1789297149.239510:0:6320:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297149.239579:0:6320:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d06528a4 going to sleep for 11 seconds 00000100:00100000:2.0:1789297149.240251:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136256 00000100:00100000:2.0:1789297149.240261:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136256 00000100:00100000:2.0:1789297149.240327:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297149.240335:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ed9af853 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:6320:x1876213957136256:12345-0@lo:104: 00010000:00010000:2.0:1789297149.240360:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243155:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789297149.243164:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ed9af853 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:6320:x1876213957136256:12345-0@lo:104: Request processed in 2828us (3652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297149.243176:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789297149.243225:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297149.243232:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243240:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000032a3e36c already unused, calling callback (00000000f6e4c643) 10000000:00010000:2.0:1789297149.243243:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243253:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297149.243259:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297149.243265:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789297149.243303:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243310:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297149.243330:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243335:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: 0000000032a3e36c/0x8ad177e823a0b19c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1a3 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243469:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297149.243472:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297149.243473:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297149.243503:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000c66eb59f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957136384:0@lo:103: 00000100:00100000:2.0:1789297149.243548:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297149.243615:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136384 00000100:00100000:2.0:1789297149.243622:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136384 00010000:00010000:2.0:1789297149.243647:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 12 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297149.243674:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297149.243681:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043aeea6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3303:x1876213957136384:12345-0@lo:103: 00010000:00010000:2.0:1789297149.243692:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297149.243696:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 12 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243734:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 12 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243750:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243758:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243771:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243777:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243789:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243795:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243800:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ad7c78e3 already unused, calling callback (00000000e84b1d5c) 00010000:00010000:2.0:1789297149.243803:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243810:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243818:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.243827:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297149.244022:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000fc84eb0a/0x8ad177e823a0b1a3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b19c expref: 12 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297149.244035:0:6320:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ace27880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6320:1876213957136256:0@lo:104: 00010000:00010000:3.0:1789297149.244060:0:6320:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297149.244068:0:6320:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297149.244073:0:6320:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297149.244078:0:6320:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ad7c78e3/0x8ad177e823a0b1e2 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6320 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297149.245625:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043aeea6c pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:3303:x1876213957136384:12345-0@lo:103: Request processed in 1938us (2070us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297149.245640:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297149.247387:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000c66eb59f pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957136384:0@lo:103: 00010000:00010000:3.0:1789297149.374451:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1789297149.716830:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789297149.716839:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b07359800 from 1 10000000:01000000:2.0:1789297149.716845:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789297149.716893:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: 000000005a2dd90b/0x8ad177e823a0b1e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.716906:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: 000000005a2dd90b/0x8ad177e823a0b1e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.716917:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: 000000005a2dd90b/0x8ad177e823a0b1e9 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297149.716956:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb30d815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957136512:0@lo:101: 00000100:00100000:2.0:1789297149.717048:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297149.717122:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000003782c1d9 going to sleep for 11 seconds 00000100:00100000:0.0:1789297149.717232:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136512 00000100:00100000:0.0:1789297149.717239:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136512 00000100:00100000:0.0:1789297149.717289:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789297149.717298:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000194b528b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:5839:x1876213957136512:12345-0@lo:101: 00010000:00010000:0.0:1789297149.717312:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297149.717325:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000007fab38ba/0x8ad177e823a0b1f0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b1e9 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297149.717348:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000007fab38ba/0x8ad177e823a0b1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297149.717371:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000007fab38ba/0x8ad177e823a0b1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297149.717381:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000007fab38ba, rc 0) 00000100:00100000:0.0:1789297149.717431:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000194b528b pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957136512:12345-0@lo:101: Request processed in 134us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297149.717437:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1789297149.717671:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb30d815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957136512:0@lo:101: 00010000:00010000:2.0:1789297149.717686:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: 000000005a2dd90b/0x8ad177e823a0b1e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.717694:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: 000000005a2dd90b/0x8ad177e823a0b1e9 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297149.717772:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb30d815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957136640:0@lo:501: 00000100:00100000:2.0:1789297149.717802:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297149.717826:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000003782c1d9 going to sleep for 11 seconds 00000100:00100000:1.0:1789297149.718189:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136640 00000100:00100000:1.0:1789297149.718195:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136640 00000100:00100000:1.0:1789297149.718237:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297149.718243:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000dd8329ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957136640:12345-0@lo:501: 00000100:00100000:1.0:1789297149.718498:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000dd8329ed pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957136640:12345-0@lo:501: Request processed in 254us (694us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297149.718505:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789297149.718720:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb30d815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957136640:0@lo:501: 00000100:00100000:2.0:1789297149.718753:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000bb30d815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957136768:0@lo:503: 00000100:00100000:2.0:1789297149.718792:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297149.718818:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set 000000003782c1d9 going to sleep for 11 seconds 00000100:00100000:0.0:1789297149.718927:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136768 00000100:00100000:0.0:1789297149.718932:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136768 00000100:00100000:0.0:1789297149.718958:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789297149.718963:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000000b1dda93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957136768:12345-0@lo:503: 00000100:00100000:0.0:1789297149.719111:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000000b1dda93 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957136768:12345-0@lo:503: Request processed in 147us (320us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297149.719117:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789297149.719311:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000bb30d815 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957136768:0@lo:503: 00000100:00100000:0.0:1789297149.720125:0:6332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000031e08b2b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6332:1876213957136896:0@lo:502: 00000100:00100000:0.0:1789297149.720169:0:6332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297149.720218:0:6332:0:(client.c:2715:ptlrpc_set_wait()) set 000000009cd6c80c going to sleep for 11 seconds 00000100:00100000:2.0:1789297149.720394:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957136896 00000100:00100000:2.0:1789297149.720400:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957136896 00000100:00100000:2.0:1789297149.720437:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789297149.720445:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000069f27c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6332:x1876213957136896:12345-0@lo:502: 00000100:00100000:2.0:1789297149.720612:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000069f27c95 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6332:x1876213957136896:12345-0@lo:502: Request processed in 168us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297149.720629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1789297149.720922:0:6332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000031e08b2b pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6332:1876213957136896:0@lo:502: 00000020:01000000:0.0:1789297149.720948:0:6332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297149.720958:0:6332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297149.720960:0:6332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789297149.720966:0:6332:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b07359800 00000020:00000080:0.0:1789297149.720969:0:6332:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789297149.721009:0:6332:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e14a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6332:1876213957137024:0@lo:502: 00000100:00100000:0.0:1789297149.721059:0:6332:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297149.721088:0:6332:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7840 going to sleep for 11 seconds 00000100:00100000:3.0:1789297149.721147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137024 00000100:00100000:3.0:1789297149.721153:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137024 00000100:00100000:3.0:1789297149.721206:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789297149.721222:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6332:x1876213957137024:12345-0@lo:502: 00000100:00100000:3.0:1789297149.721593:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6332:x1876213957137024:12345-0@lo:502: Request processed in 134us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297149.721602:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789297149.721966:0:6332:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e14a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6332:1876213957137024:0@lo:502: 00000020:01000000:0.0:1789297149.721991:0:6332:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297149.721998:0:6332:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297149.722000:0:6332:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789297149.722003:0:6332:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:2.0:1789297149.722217:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:2.0:1789297149.722240:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789297149.722252:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297149.722263:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297150.398211:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297151.421851:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297152.444917:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297153.469579:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297153.470574:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957137152:0@lo:400: 00000100:00100000:3.0:1789297153.470646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297153.470695:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297153.470731:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957137280:0@lo:400: 00000100:00100000:3.0:1789297153.470759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297153.470800:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137152 00000100:00100000:2.0:1789297153.470806:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137280 00000100:00100000:3.0:1789297153.470808:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137152 00000100:00100000:2.0:1789297153.470810:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137280 00000100:00100000:3.0:1789297153.470848:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1789297153.470848:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297153.470856:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3304:x1876213957137152:12345-0@lo:400: 00000100:00100000:2.0:1789297153.470856:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957137280:12345-0@lo:400: 00000100:00100000:2.0:1789297153.470904:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957137280:12345-0@lo:400: Request processed in 49us (143us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297153.470911:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297153.471098:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3304:x1876213957137152:12345-0@lo:400: Request processed in 242us (452us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297153.471105:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:3.0:1789297153.471217:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982b41ef7100 x1876213957137280/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297169 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297153.471234:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957137280:0@lo:400: 00000100:00100000:3.0:1789297153.471247:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957137152:0@lo:400: 00010000:00010000:1.0:1789297154.496320:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297155.516853:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297156.550383:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789297156.762391:0:6684:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789297156.762398:0:6684:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:0.0:1789297156.762571:0:6684:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982b121d2000 00000020:01000004:0.0:1789297156.762589:0:6684:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:0.0:1789297156.762602:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:0.0:1789297156.762626:0:6684:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff982b40b419b8) 00000020:00000080:0.0:1789297156.762653:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789297156.781875:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:2.0:1789297156.782122:0:6684:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1789297156.807935:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:3.0:1789297156.815441:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:3.0:1789297156.815471:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:3.0:1789297156.815533:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:3.0:1789297156.815570:0:6684:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1789297156.815998:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:3.0:1789297156.816007:0:6684:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:3.0:1789297156.816018:0:6684:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ad177e823a0b1fe 00000020:01000004:3.0:1789297156.816025:0:6684:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:3.0:1789297156.816046:0:6684:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1789297156.816049:0:6684:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1789297156.816055:0:6684:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:3.0:1789297156.816059:0:6684:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:3.0:1789297156.816068:0:6684:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff982b27c48000) 00000020:00000080:3.0:1789297156.816081:0:6684:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:3.0:1789297156.817949:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789297156.818843:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:3.0:1789297156.818853:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:3.0:1789297156.820475:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:3.0:1789297156.820489:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1789297156.827221:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1789297156.827237:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:1.0:1789297156.829407:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789297156.829990:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:1.0:1789297156.829998:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:1.0:1789297156.830869:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:1.0:1789297156.830878:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1789297156.866466:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297156.866891:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:0.0:1789297156.866897:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:0.0:1789297156.870900:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:0.0:1789297156.870918:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:0.0:1789297156.872288:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789297156.872306:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:0.0:1789297156.875564:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297156.875969:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:0.0:1789297156.875975:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:0.0:1789297156.887430:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:0.0:1789297156.887453:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:1.0:1789297156.955393:0:6684:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789297156.955601:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:1.0:1789297156.955671:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:1.0:1789297156.958069:0:6684:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:1.0:1789297156.958082:0:6684:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1789297156.958844:0:6684:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1789297156.958869:0:6684:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1789297156.958875:0:6684:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:2.0:1789297156.995573:0:6684:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789297156.995610:0:6684:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20062 00000020:01000004:2.0:1789297156.995614:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789297156.995616:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789297156.995618:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789297156.995619:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789297156.995620:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789297156.995622:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789297156.995623:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789297156.995628:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789297156.995629:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789297156.995630:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789297156.995631:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789297156.995635:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:2.0:1789297156.995637:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789297156.995638:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789297156.995639:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789297156.995640:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789297156.995641:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789297156.995642:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789297156.995643:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789297156.995644:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1789297156.995645:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1789297156.995646:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789297156.995647:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789297156.995679:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:2.0:1789297156.995699:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957137408:0@lo:253: 00000100:00100000:2.0:1789297156.995794:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297156.996018:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137408 00000100:00100000:0.0:1789297156.996029:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137408 00000100:00100000:0.0:1789297156.996078:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789297156.996087:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957137408:12345-0@lo:253: 20000000:01000000:0.0:1789297156.996116:0:5837:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789297156.996120:0:5837:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:0.0:1789297156.996125:0:5837:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:0.0:1789297156.996129:0:5837:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:0.0:1789297156.997041:0:5837:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297156.997257:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:0.0:1789297156.997273:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:0.0:1789297156.997326:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:0.0:1789297156.997335:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:0.0:1789297156.997365:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:0.0:1789297156.997417:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:0.0:1789297156.997855:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:0.0:1789297156.997878:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:0.0:1789297156.997880:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789297156.997923:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:0.0:1789297156.997932:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789297156.997982:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:0.0:1789297156.997991:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:0.0:1789297156.998021:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:0.0:1789297156.998031:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789297156.998061:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:0.0:1789297156.998110:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:0.0:1789297156.998831:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:0.0:1789297156.998849:0:5837:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:0.0:1789297156.998851:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789297156.998886:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:0.0:1789297156.998894:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:0.0:1789297156.998924:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:0.0:1789297156.998930:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:0.0:1789297156.998992:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:0.0:1789297156.999002:0:5837:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:0.0:1789297156.999034:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:0.0:1789297156.999071:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:0.0:1789297156.999087:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:0.0:1789297156.999090:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:0.0:1789297156.999096:0:5837:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:0.0:1789297156.999098:0:5837:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:0.0:1789297156.999100:0:5837:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:0.0:1789297156.999113:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789297156.999116:0:5837:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:0.0:1789297156.999147:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:0.0:1789297156.999150:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:0.0:1789297156.999468:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:0.0:1789297156.999510:0:6699:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000100:00100000:2.0:1789297157.003632:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad5b40 going to sleep for 10 seconds 00000040:00080000:0.0:1789297157.004088:0:6699:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:0.0:1789297157.007208:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:0.0:1789297157.007277:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:0.0:1789297157.007314:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:0.0:1789297157.007327:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:0.0:1789297157.007330:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:0.0:1789297157.008591:0:6700:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1789297157.009019:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1789297157.009067:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1789297157.009136:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1789297157.009152:0:5837:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789297157.009154:0:5837:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789297157.013329:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 13 marker 10 1->4: lustre sys.timeout 20000000:01000000:3.0:1789297157.013422:0:6701:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 15 marker 10 2->4: lustre sys.timeout 00000040:00080000:3.0:1789297157.013471:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:0.0:1789297157.018484:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:0.0:1789297157.018553:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:0.0:1789297157.018625:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 10000000:01000000:0.0:1789297157.018642:0:5837:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:0.0:1789297157.018662:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.018682:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b125 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.018689:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00031000/0x8ad177e823a0b141 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.018695:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00031800/0x8ad177e823a0b1b1 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.018803:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.018846:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00031800/0x8ad177e823a0b1b1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.018861:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b00031800/0x8ad177e823a0b1b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 12 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297157.018877:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e14a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876213957137536:0@lo:104: 00000100:00100000:0.0:1789297157.018943:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297157.019059:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00031000/0x8ad177e823a0b141 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.019068:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b00031000/0x8ad177e823a0b141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 12 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297157.019077:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876213957137664:0@lo:104: 00000100:00100000:0.0:1789297157.019099:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297157.019263:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.019272:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 12 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297157.019281:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876213957137792:0@lo:104: 00000100:00100000:0.0:1789297157.019303:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.029830:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137536 00000100:00100000:2.0:1789297157.029848:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137536 00000100:00100000:2.0:1789297157.029906:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137664 00000100:00100000:2.0:1789297157.029910:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137664 00000100:00100000:2.0:1789297157.029929:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297157.029939:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:5837:x1876213957137536:12345-0@lo:104: 00010000:00010000:2.0:1789297157.029956:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030047:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789297157.030066:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:5837:x1876213957137536:12345-0@lo:104: Request processed in 128us (11123us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.030073:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297157.030094:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297157.030100:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5837:x1876213957137664:12345-0@lo:104: 00010000:00010000:2.0:1789297157.030108:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030143:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789297157.030148:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5837:x1876213957137664:12345-0@lo:104: Request processed in 49us (11049us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.030154:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789297157.030180:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789297157.030186:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030193:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063a00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297157.030197:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030205:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297157.030213:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297157.030220:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789297157.030378:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030395:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297157.030428:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030436:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b1aa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1b1 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030449:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297157.030452:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030457:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b800 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297157.030460:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030466:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297157.030471:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297157.030476:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789297157.030488:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030494:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297157.030499:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030505:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152b800/0x8ad177e823a0b13a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b141 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.030529:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297157.030531:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297157.030533:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297157.030579:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957137920:0@lo:103: 00000100:00100000:3.0:1789297157.030620:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.030665:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789297157.030672:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957138048:0@lo:103: 00000100:00100000:3.0:1789297157.030692:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.030741:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137920 00000100:00100000:3.0:1789297157.030746:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137920 00010000:00010000:3.0:1789297157.030763:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00031800/0x8ad177e823a0b1b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 13 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297157.030783:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138048 00000100:00100000:3.0:1789297157.030791:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138048 00010000:00010000:3.0:1789297157.030802:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00031000/0x8ad177e823a0b141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 14 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297157.030814:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297157.030820:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3302:x1876213957137920:12345-0@lo:103: 00010000:00010000:3.0:1789297157.030830:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297157.030835:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00031800/0x8ad177e823a0b1b1 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 14 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.030844:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00031800/0x8ad177e823a0b1b1 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 14 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.030860:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297157.030885:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3302:x1876213957137920:12345-0@lo:103: Request processed in 65us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297157.030891:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297157.030902:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297157.030908:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:3302:x1876213957138048:12345-0@lo:103: 00010000:00010000:3.0:1789297157.030915:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297157.030919:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00031000/0x8ad177e823a0b141 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 13 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.030927:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00031000/0x8ad177e823a0b141 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 13 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.030935:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297157.030953:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f57100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:3302:x1876213957138048:12345-0@lo:103: Request processed in 46us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297157.030958:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297157.030997:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957138048:0@lo:103: 00000100:00100000:3.0:1789297157.031006:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957137920:0@lo:103: 00010000:00010000:3.0:1789297157.031782:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297157.032687:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffd80 going to sleep for 11 seconds 00010000:00010000:0.0:1789297157.032727:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031800/0x8ad177e823a0b1b1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b1aa expref: 12 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297157.032745:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e14a80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876213957137536:0@lo:104: 00010000:00010000:0.0:1789297157.032758:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031000/0x8ad177e823a0b141 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b13a expref: 11 pid: 5837 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297157.032771:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876213957137664:0@lo:104: 00000100:00100000:2.0:1789297157.032773:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957137792 00000100:00100000:2.0:1789297157.032779:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957137792 00000100:00100000:2.0:1789297157.032816:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297157.032825:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5837:x1876213957137792:12345-0@lo:104: 00010000:00010000:2.0:1789297157.032838:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.032914:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789297157.032920:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5837:x1876213957137792:12345-0@lo:104: Request processed in 97us (13616us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297157.032922:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16680 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0002:MGS:5837:1876213957137792:0@lo:104: 00000100:00100000:2.0:1789297157.032927:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00010000:0.0:1789297157.032945:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.032971:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297157.032977:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.032984:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297157.032987:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.032994:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297157.033001:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297157.033006:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789297157.033045:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033052:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297157.033082:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033090:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b11e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b125 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033111:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297157.033113:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297157.033126:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297157.033165:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957138176:0@lo:103: 00000100:00100000:2.0:1789297157.033197:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.033316:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138176 00000100:00100000:3.0:1789297157.033321:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138176 00010000:00010000:3.0:1789297157.033338:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 11 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297157.033361:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789297157.033368:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:3304:x1876213957138176:12345-0@lo:103: 00010000:00010000:3.0:1789297157.033377:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297157.033381:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b125 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 11 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033392:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b125 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 11 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033406:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b125 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b11e expref: 11 pid: 5836 timeout: 318 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033419:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033427:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033439:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033446:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033452:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033468:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033474:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297157.033478:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033485:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033506:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.033514:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297157.033555:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:3304:x1876213957138176:12345-0@lo:103: Request processed in 187us (357us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297157.033562:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789297157.033587:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957138176:0@lo:103: 00010000:00010000:0.0:1789297157.033599:0:5837:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.033622:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.033629:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031600/0x8ad177e823a0b20c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789297157.033642:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789297157.127093:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:6684:x1876213957137408:12345-0@lo:253: Request processed in 130997us (131289us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297157.127108:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789297157.127211:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957137408:0@lo:253: 10000000:01000000:2.0:1789297157.127227:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:2.0:1789297157.127230:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789297157.127232:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:2.0:1789297157.127233:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789297157.127235:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:2.0:1789297157.127236:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789297157.127237:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789297157.127239:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789297157.127241:0:6684:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789297157.127242:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789297157.127243:0:6684:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789297157.127264:0:6684:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982b121d2000 from lustre-OST0000 10000000:01000000:2.0:1789297157.127412:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:2.0:1789297157.127415:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789297157.127421:0:6684:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982b18368000 local copy 10000000:01000000:2.0:1789297157.127425:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789297157.127463:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.127475:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.127485:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297157.127504:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138304:0@lo:101: 00000100:00100000:2.0:1789297157.127548:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.127638:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad59c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297157.127777:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138304 00000100:00100000:3.0:1789297157.127784:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138304 00000100:00100000:2.0:1789297157.127891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789297157.127901:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:6684:x1876213957138304:12345-0@lo:101: 00010000:00010000:2.0:1789297157.127915:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297157.127929:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20063600/0x8ad177e823a0b21a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b213 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.127956:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063600/0x8ad177e823a0b21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b213 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.127966:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20063600/0x8ad177e823a0b21a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b213 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.127974:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20063600, rc 0) 00000100:00100000:2.0:1789297157.128048:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:6684:x1876213957138304:12345-0@lo:101: Request processed in 148us (499us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.128061:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789297157.128162:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138304:0@lo:101: 00010000:00010000:3.0:1789297157.128175:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.128185:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297157.128408:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138432:0@lo:501: 00000100:00100000:3.0:1789297157.128441:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.128504:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297157.128547:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138432 00000100:00100000:1.0:1789297157.128551:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138432 00000100:00100000:1.0:1789297157.128619:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789297157.128628:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:6684:x1876213957138432:12345-0@lo:501: 00000100:00100000:1.0:1789297157.128869:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:6684:x1876213957138432:12345-0@lo:501: Request processed in 242us (426us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789297157.128876:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789297157.128937:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138432:0@lo:501: 10000000:01000000:3.0:1789297157.128950:0:6684:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:3.0:1789297157.128973:0:6684:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:3.0:1789297157.128978:0:6684:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.128986:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.128993:0:6684:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.129016:0:6684:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789297157.129032:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982b121d2000 10000000:01000000:3.0:1789297157.129036:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1789297157.129041:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff982b18368000 10000000:01000000:3.0:1789297157.129043:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:3.0:1789297157.129046:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff982b18368000 from 1 10000000:01000000:3.0:1789297157.129049:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:3.0:1789297157.129068:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.129075:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.129083:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297157.129108:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138560:0@lo:101: 00000100:00100000:3.0:1789297157.129132:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297157.129174:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297157.129181:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.129189:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063a00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297157.129192:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x400000000 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.129200:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x8400000000 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297157.129208:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x9400000000 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297157.129213:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789297157.129233:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.129239:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297157.129276:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.129283:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b213 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ad177e823a0b21a expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.129315:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297157.129317:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297157.129319:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297157.129331:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957138688:0@lo:103: 00000100:00100000:0.0:1789297157.129361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.129639:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.129717:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138560 00000100:00100000:2.0:1789297157.129723:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138560 00000100:00100000:2.0:1789297157.129746:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789297157.129752:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:6684:x1876213957138560:12345-0@lo:101: 00010000:00010000:2.0:1789297157.129760:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297157.129770:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20063e00/0x8ad177e823a0b228 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b221 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.129787:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063e00/0x8ad177e823a0b228 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b221 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.129796:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20063e00/0x8ad177e823a0b228 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b221 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.129803:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20063e00, rc 0) 00000100:00100000:2.0:1789297157.129839:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957138560:12345-0@lo:101: Request processed in 87us (706us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.129845:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789297157.129871:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138688 00000100:00100000:2.0:1789297157.129875:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138688 00000100:00100000:2.0:1789297157.129898:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297157.129903:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:3305:x1876213957138688:12345-0@lo:103: 00010000:00010000:2.0:1789297157.129910:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297157.129919:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063600/0x8ad177e823a0b21a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b213 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.129929:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297157.129956:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:3305:x1876213957138688:12345-0@lo:103: Request processed in 53us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.129962:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297157.129989:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957138688:0@lo:103: 00000100:00100000:3.0:1789297157.130049:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138560:0@lo:101: 00010000:00010000:3.0:1789297157.130061:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b228 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.130070:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b228 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297157.130085:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:3.0:1789297157.130100:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b228 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.130107:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b228 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297157.130114:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:3.0:1789297157.130118:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789297157.130123:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:3.0:1789297157.130126:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1789297157.130140:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.130146:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.130154:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297157.130171:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138816:0@lo:101: 00000100:00100000:3.0:1789297157.130196:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.130213:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.130363:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138816 00000100:00100000:2.0:1789297157.130367:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138816 00000100:00100000:2.0:1789297157.130385:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789297157.130390:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+10:6684:x1876213957138816:12345-0@lo:101: 00010000:00010000:2.0:1789297157.130396:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297157.130404:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b22f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.130416:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.130423:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.130430:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20062800, rc 0) 00000100:00100000:2.0:1789297157.130461:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957138816:12345-0@lo:101: Request processed in 70us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.130466:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789297157.130537:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138816:0@lo:101: 00010000:00010000:3.0:1789297157.130546:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.130553:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297157.130639:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138944:0@lo:501: 00000100:00100000:3.0:1789297157.130663:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.130683:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.130781:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957138944 00000100:00100000:2.0:1789297157.130785:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957138944 00000100:00100000:2.0:1789297157.130801:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789297157.130805:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957138944:12345-0@lo:501: 00000100:00100000:2.0:1789297157.130984:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957138944:12345-0@lo:501: Request processed in 178us (320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.130997:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789297157.131077:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957138944:0@lo:501: 00000100:00100000:3.0:1789297157.131103:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139072:0@lo:503: 00000100:00100000:3.0:1789297157.131139:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.131164:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.131205:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139072 00000100:00100000:2.0:1789297157.131209:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139072 00000100:00100000:2.0:1789297157.131225:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789297157.131231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957139072:12345-0@lo:503: 00000100:00100000:2.0:1789297157.131498:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957139072:12345-0@lo:503: Request processed in 266us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.131504:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789297157.131581:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139072:0@lo:503: 00000040:00080000:3.0:1789297157.131860:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1789297157.131920:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139200:0@lo:502: 00000100:00100000:3.0:1789297157.131947:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.131964:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.132030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139200 00000100:00100000:2.0:1789297157.132035:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139200 00000100:00100000:2.0:1789297157.132051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:2.0:1789297157.132057:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957139200:12345-0@lo:502: 00000100:00100000:2.0:1789297157.132179:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957139200:12345-0@lo:502: Request processed in 122us (230us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.132186:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789297157.132272:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139200:0@lo:502: 00000040:00080000:3.0:1789297157.132504:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1789297157.132567:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1789297157.132594:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1789297157.132635:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1789297157.132666:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1789297157.132737:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1789297157.132759:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139328:0@lo:502: 00000100:00100000:3.0:1789297157.132789:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.132814:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.133013:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139328 00000100:00100000:2.0:1789297157.133018:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139328 00000100:00100000:2.0:1789297157.133038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789297157.133044:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957139328:12345-0@lo:502: 00000100:00100000:2.0:1789297157.133197:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957139328:12345-0@lo:502: Request processed in 151us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.133204:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789297157.133428:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139328:0@lo:502: 00000040:00080000:3.0:1789297157.133532:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1789297157.133544:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:3.0:1789297157.133982:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789297157.133990:0:6702:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:3.0:1789297157.133996:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297157.133999:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:3.0:1789297157.134002:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789297157.134029:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff982a017019b8) 00000020:00000080:3.0:1789297157.134053:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789297157.134060:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789297157.134122:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b121d2000 from lustre-OST0000, refs=2 00080000:01000000:3.0:1789297157.134129:0:6702:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789297157.134152:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ad177e823a0b244 00010000:00010000:2.0:1789297157.139656:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1789297157.140022:0:6702:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:2.0:1789297157.142409:0:6702:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789297157.142687:0:6702:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:2.0:1789297157.149023:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789297157.149793:0:6702:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1789297157.151027:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1789297157.151038:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789297157.151045:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297157.151047:0:6702:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1789297157.151050:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789297157.151054:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297157.151055:0:6702:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1789297157.151057:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1789297157.151059:0:6702:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1789297157.151105:0:6702:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789297157.151112:0:6702:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297157.151113:0:6702:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789297157.151185:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1789297157.153813:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:2.0:1789297157.153857:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1789297157.153877:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.153892:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297157.153901:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b121d2000 from 1 10000000:01000000:2.0:1789297157.153904:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789297157.153945:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.153954:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.153965:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297157.153990:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139456:0@lo:101: 00000100:00100000:2.0:1789297157.154065:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.154112:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad5c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.154163:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139456 00000100:00100000:2.0:1789297157.154171:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139456 00000100:00100000:2.0:1789297157.154214:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789297157.154221:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:6684:x1876213957139456:12345-0@lo:101: 00010000:00010000:2.0:1789297157.154234:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297157.154245:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b24b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.154285:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.154399:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.154409:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20062600, rc 0) 00000100:00100000:2.0:1789297157.154448:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139456:12345-0@lo:101: Request processed in 226us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.154454:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789297157.154499:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139456:0@lo:101: 00010000:00010000:2.0:1789297157.154512:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.154534:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297157.154644:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139584:0@lo:501: 00000100:00100000:2.0:1789297157.154665:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.154678:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1dcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.154691:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139584 00000100:00100000:2.0:1789297157.154695:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139584 00000100:00100000:2.0:1789297157.154738:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789297157.154744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139584:12345-0@lo:501: 00000100:00100000:2.0:1789297157.159810:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139584:12345-0@lo:501: Request processed in 5054us (5132us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.159826:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789297157.164551:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139584:0@lo:501: 00000100:00100000:2.0:1789297157.164688:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139712:0@lo:503: 00000100:00100000:2.0:1789297157.164807:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.164854:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d900 going to sleep for 11 seconds 00000100:00100000:1.0:1789297157.164964:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139712 00000100:00100000:1.0:1789297157.164971:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139712 00000100:00100000:1.0:1789297157.165032:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789297157.165041:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139712:12345-0@lo:503: 00000100:00100000:1.0:1789297157.165549:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139712:12345-0@lo:503: Request processed in 506us (740us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297157.165568:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789297157.165661:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139712:0@lo:503: 00000040:00080000:2.0:1789297157.165994:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789297157.166057:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139840:0@lo:502: 00000100:00100000:2.0:1789297157.166093:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297157.166224:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139840 00000100:00100000:3.0:1789297157.166230:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139840 00000100:00100000:3.0:1789297157.166273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789297157.166282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139840:12345-0@lo:502: 00000100:00100000:3.0:1789297157.166564:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139840:12345-0@lo:502: Request processed in 283us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297157.166572:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789297157.166630:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297157.166648:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139840:0@lo:502: 00000040:00080000:2.0:1789297157.166921:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:2.0:1789297157.166964:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:2.0:1789297157.166985:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139968:0@lo:502: 00000100:00100000:2.0:1789297157.167014:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.167038:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d900 going to sleep for 11 seconds 00000100:00100000:3.0:1789297157.167100:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957139968 00000100:00100000:3.0:1789297157.167104:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957139968 00000100:00100000:3.0:1789297157.167140:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789297157.167147:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139968:12345-0@lo:502: 00000100:00100000:3.0:1789297157.167266:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957139968:12345-0@lo:502: Request processed in 119us (251us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297157.167273:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1789297157.167507:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957139968:0@lo:502: 00000040:00080000:2.0:1789297157.167608:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1789297157.167619:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1789297157.174208:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297157.174220:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297157.174222:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789297157.174229:0:6706:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b121d2000 00000020:00000080:2.0:1789297157.174231:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789297157.174370:0:6706:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297157.174374:0:6706:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297157.174376:0:6706:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1789297157.174379:0:6706:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:0.0:1789297157.174546:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1789297157.174570:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789297157.174629:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.174642:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297157.174686:0:6684:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1789297157.174689:0:6684:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982b121d2000 10000000:01000000:0.0:1789297157.174692:0:6684:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982b121d2000 10000000:01000000:0.0:1789297157.174696:0:6684:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789297157.174729:0:6684:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b121d2000 from 1 10000000:01000000:0.0:1789297157.174732:0:6684:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789297157.174767:0:6684:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.174775:0:6684:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297157.174786:0:6684:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297157.174809:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140096:0@lo:101: 00000100:00100000:0.0:1789297157.174882:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297157.174918:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffc00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297157.174983:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140096 00000100:00100000:3.0:1789297157.174991:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140096 00000100:00100000:3.0:1789297157.175035:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789297157.175042:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957140096:12345-0@lo:101: 00010000:00010000:3.0:1789297157.175055:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297157.175067:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b259 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.175090:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.175101:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297157.175126:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b600, rc 0) 00000100:00100000:3.0:1789297157.175166:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140096:12345-0@lo:101: Request processed in 123us (283us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297157.175172:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789297157.175421:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e14a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140096:0@lo:101: 00010000:00010000:1.0:1789297157.175436:0:6684:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.175446:0:6684:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297157.175561:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140224:0@lo:501: 00000100:00100000:1.0:1789297157.175592:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297157.175623:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297157.175670:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140224 00000100:00100000:0.0:1789297157.175674:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140224 00000100:00100000:0.0:1789297157.175729:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1789297157.175737:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140224:12345-0@lo:501: 00000100:00100000:0.0:1789297157.175956:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140224:12345-0@lo:501: Request processed in 219us (362us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297157.175963:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789297157.176090:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140224:0@lo:501: 00000100:00100000:1.0:1789297157.176132:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140352:0@lo:503: 00000100:00100000:1.0:1789297157.176169:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297157.176196:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297157.176364:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140352 00000100:00100000:0.0:1789297157.176369:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140352 00000100:00100000:0.0:1789297157.176400:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789297157.176407:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140352:12345-0@lo:503: 00000100:00100000:0.0:1789297157.176570:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140352:12345-0@lo:503: Request processed in 163us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297157.176576:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1789297157.176754:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140352:0@lo:503: 00000040:00080000:1.0:1789297157.177032:0:6684:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789297157.177102:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140480:0@lo:502: 00000100:00100000:1.0:1789297157.177258:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297157.177380:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297157.177597:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140480 00000100:00100000:3.0:1789297157.177602:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140480 00000100:00100000:3.0:1789297157.177666:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789297157.177675:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140480:12345-0@lo:502: 00000100:00100000:2.0:1789297157.178001:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140480:12345-0@lo:502: Request processed in 326us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.178017:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789297157.178084:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140480:0@lo:502: 00000040:00080000:1.0:1789297157.178348:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789297157.178398:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789297157.178431:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789297157.178476:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789297157.178538:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789297157.178587:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789297157.178624:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789297157.178656:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789297157.178738:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789297157.178776:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789297157.178807:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789297157.178852:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789297157.178884:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789297157.178913:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789297157.178956:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789297157.178985:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789297157.179032:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789297157.179079:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789297157.179114:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789297157.179145:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789297157.179191:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789297157.179224:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789297157.179257:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789297157.179305:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789297157.179340:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789297157.179374:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789297157.179423:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789297157.179456:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:1.0:1789297157.179495:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140608:0@lo:502: 00000100:00100000:1.0:1789297157.179573:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297157.180283:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297157.180411:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140608 00000100:00100000:0.0:1789297157.180420:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140608 00000100:00100000:2.0:1789297157.180592:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789297157.180602:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140608:12345-0@lo:502: 00000100:00100000:2.0:1789297157.180866:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140608:12345-0@lo:502: Request processed in 264us (1291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.180873:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789297157.181249:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140608:0@lo:502: 00000040:00080000:1.0:1789297157.181437:0:6684:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789297157.181450:0:6684:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:2.0:1789297157.182154:0:6707:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1789297157.182169:0:6707:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff982b02e419b8) 00000020:00000080:2.0:1789297157.182190:0:6707:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:2.0:1789297157.182438:0:6707:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b121d2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789297157.182442:0:6707:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982b121d2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1789297157.182445:0:6707:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b121d2000 3 00010000:00080000:2.0:1789297157.182477:0:6707:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a01dcd000@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789297157.185029:0:6707:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:2.0:1789297157.185526:0:6707:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1789297157.185572:0:6707:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789297157.185589:0:6707:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8ad177e823a0b26e 00000100:00080000:2.0:1789297157.185599:0:6707:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789297157.185606:0:6707:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff982a01dcd000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789297157.185647:0:6707:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b41ee6300 x1876213957140736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789297157.185752:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876213957140736:0@lo:38: 00000100:00100000:0.0:1789297157.185830:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1789297157.185916:0:6707:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1789297157.185983:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957140864:0@lo:400: 00000100:00100000:2.0:1789297157.186014:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.186058:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140736 00000100:00100000:2.0:1789297157.186066:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140736 00000100:00100000:2.0:1789297157.186394:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140864 00000100:00100000:2.0:1789297157.186399:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140864 00000100:00100000:2.0:1789297157.186446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297157.186457:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957140864:12345-0@lo:400: 00000100:00100000:2.0:1789297157.186538:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957140864:12345-0@lo:400: Request processed in 83us (521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.186545:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297157.186561:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297157.186566:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876213957140736:12345-0@lo:38: 00010000:00080000:2.0:1789297157.186586:0:5842:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 169 last 0 00000020:00000080:2.0:1789297157.186616:0:5842:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8ad177e823a0b275 00000004:00100000:2.0:1789297157.186633:0:5842:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789297157.186668:0:5842:0:(import.c:65:import_set_state_nolock()) ffff982a01dc8000 : changing import state from RECOVER to FULL 00010000:00080000:3.0:1789297157.186767:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982b41ee5880 x1876213957140864/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297157.186782:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957140864:0@lo:400: 00000100:00100000:2.0:1789297157.188502:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876213957140736:12345-0@lo:38: Request processed in 1921us (2659us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.188527:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000040:00080000:3.0:1789297157.191559:0:6707:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:1.0:1789297157.192388:0:6684:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:1.0:1789297157.192434:0:6684:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789297157.192463:0:6684:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.192478:0:6684:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789297157.192537:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789297157.192539:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789297157.192540:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297157.192542:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297157.192544:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297157.192545:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297157.192547:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789297157.192549:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789297157.192550:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789297157.192552:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297157.192553:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789297157.192556:0:6684:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:1.0:1789297157.192559:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789297157.192560:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789297157.192561:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297157.192562:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297157.192564:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297157.192565:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297157.192566:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789297157.192567:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789297157.192568:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789297157.192569:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297157.192570:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789297157.192600:0:6684:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1789297157.192623:0:6684:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140992:0@lo:253: 00000100:00100000:1.0:1789297157.192733:0:6684:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297157.192779:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957140992 00000100:00100000:1.0:1789297157.192787:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957140992 00000100:00100000:1.0:1789297157.192837:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789297157.192853:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:6684:x1876213957140992:12345-0@lo:253: 20000000:01000000:1.0:1789297157.192891:0:5837:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789297157.192905:0:5837:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789297157.194096:0:6684:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb76c0 going to sleep for 11 seconds 00010000:00080000:0.0:1789297157.195365:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982b41ee6300 x1876213957140736/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789297167 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297157.195381:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789297157.195391:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:0.0:1789297157.195400:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1789297157.195405:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1789297157.195409:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982a01dcd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1789297157.195426:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876213957140736:0@lo:38: 20000000:01000000:1.0:1789297157.238900:0:5837:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1789297157.238920:0:5837:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:2.0:1789297157.238963:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789297157.238968:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789297157.238990:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.239009:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b1db lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.239017:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.239054:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b1db lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.239079:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b1db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297157.239094:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876213957141120:0@lo:104: 00000100:00100000:2.0:1789297157.239167:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.239224:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789297157.240031:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957141120 00000100:00100000:1.0:1789297157.240044:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957141120 00000100:00100000:1.0:1789297157.240098:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789297157.240107:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5858:x1876213957141120:12345-0@lo:104: 00010000:00010000:1.0:1789297157.240134:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.240204:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789297157.240210:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5858:x1876213957141120:12345-0@lo:104: Request processed in 105us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297157.240217:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:1.0:1789297157.240251:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297157.240258:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.240265:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a200 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297157.240269:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.240427:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297157.240434:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297157.240448:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1789297157.240481:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.240487:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297157.240504:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.240510:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152a200/0x8ad177e823a0b1d4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1db expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297157.240539:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297157.240541:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297157.240542:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297157.240549:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297157.240560:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957141248:0@lo:103: 00000100:00100000:1.0:1789297157.240595:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297157.240733:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957141248 00000100:00100000:2.0:1789297157.240737:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957141248 00010000:00010000:2.0:1789297157.240759:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b1db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 14 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297157.240781:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297157.240789:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3302:x1876213957141248:12345-0@lo:103: 00010000:00010000:2.0:1789297157.240801:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297157.240805:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b1db lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 14 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240814:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b1db lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 14 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240832:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240839:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789297157.240852:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003632614s 00010000:00010000:2.0:1789297157.240856:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240874:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240880:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240886:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240891:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297157.240895:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240903:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240911:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.240922:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297157.240955:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3c850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3302:x1876213957141248:12345-0@lo:103: Request processed in 167us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.240962:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297157.241022:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957141248:0@lo:103: 00010000:00010000:2.0:1789297157.241052:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b1db lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b1d4 expref: 13 pid: 5837 timeout: 319 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297157.241063:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876213957141120:0@lo:104: 00010000:00010000:2.0:1789297157.241075:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.241090:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.241097:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297157.241103:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063800/0x8ad177e823a0b27c lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297157.289425:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:6684:x1876213957140992:12345-0@lo:253: Request processed in 96565us (96683us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297157.289440:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789297157.289631:0:6684:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:6684:1876213957140992:0@lo:253: 10000000:01000000:1.0:1789297157.289648:0:6684:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1789297157.289651:0:6684:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789297157.289653:0:6684:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1789297157.289654:0:6684:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297157.289655:0:6684:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297157.289657:0:6684:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297157.289658:0:6684:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297157.289659:0:6684:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789297157.289661:0:6684:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1789297157.289662:0:6684:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1789297157.289664:0:6684:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297157.289666:0:6684:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789297157.289682:0:6684:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789297157.303774:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297157.305691:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789297157.305991:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297157.307029:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789297157.308557:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297157.309192:0:6684:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789297157.314777:0:6684:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:3.0:1789297157.565012:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789297157.566970:0:6684:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:2.0:1789297157.566979:0:6684:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1789297157.567015:0:6684:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789297157.567080:0:6684:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789297157.567098:0:6684:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1789297157.567235:0:6684:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789297158.589454:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297159.615365:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297160.647993:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297161.664540:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297162.686810:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957141376:0@lo:400: 00000100:00100000:2.0:1789297162.686890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297162.686942:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297162.686949:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957141504:0@lo:400: 00000100:00100000:2.0:1789297162.686974:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297162.687005:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957141632:0@lo:400: 00000100:00100000:2.0:1789297162.687030:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297162.687071:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957141376 00000100:00100000:2.0:1789297162.687078:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957141376 00000100:00100000:2.0:1789297162.687123:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789297162.687133:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3304:x1876213957141376:12345-0@lo:400: 00000100:00100000:2.0:1789297162.687182:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3304:x1876213957141376:12345-0@lo:400: Request processed in 50us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297162.687189:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789297162.687223:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957141504 00000100:00100000:2.0:1789297162.687227:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957141504 00000100:00100000:2.0:1789297162.687249:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957141632 00000100:00100000:2.0:1789297162.687252:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957141632 00000100:00100000:2.0:1789297162.687274:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297162.687281:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957141504:12345-0@lo:400: 00000100:00100000:2.0:1789297162.687312:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957141504:12345-0@lo:400: Request processed in 32us (337us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297162.687318:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297162.687330:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297162.687336:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957141632:12345-0@lo:400: 00000100:00100000:2.0:1789297162.687366:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957141632:12345-0@lo:400: Request processed in 30us (334us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297162.687371:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:2.0:1789297162.687413:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee4700 x1876213957141632/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297162.687428:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957141632:0@lo:400: 00010000:00080000:2.0:1789297162.687478:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee5f80 x1876213957141504/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297162.687488:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957141504:0@lo:400: 00000100:00100000:2.0:1789297162.687507:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957141376:0@lo:400: 00000100:00080000:0.0:1789297162.687696:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789297162.688573:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297163.709313:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789297164.589319:0:7051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789297164.734137:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297165.756982:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1789297166.780828:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789297166.780838:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b07359800 from 21 10000000:01000000:1.0:1789297166.780845:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789297166.780896:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297166.780910:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297166.780922:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297166.780945:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957141760:0@lo:101: 00000100:00100000:1.0:1789297166.781020:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789297166.781048:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297166.781095:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11da03c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.781101:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957141760 00000100:00100000:3.0:1789297166.781111:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957141760 00000100:00100000:3.0:1789297166.781292:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789297166.781318:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957141760:12345-0@lo:101: 00010000:00010000:3.0:1789297166.781332:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297166.781347:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b283 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297166.781372:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297166.781383:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297166.781392:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152ba00, rc 0) 00000100:00100000:3.0:1789297166.781453:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957141760:12345-0@lo:101: Request processed in 138us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.781460:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1789297166.781505:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957141760:0@lo:101: 00010000:00010000:1.0:1789297166.781523:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297166.781534:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297166.781601:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957141888:0@lo:501: 00000100:00100000:1.0:1789297166.781630:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297166.781654:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11da03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297166.781935:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957141888 00000100:00100000:2.0:1789297166.781940:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957141888 00000100:00100000:2.0:1789297166.781980:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789297166.781990:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957141888:12345-0@lo:501: 00000100:00100000:2.0:1789297166.783614:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957141888:12345-0@lo:501: Request processed in 1617us (1974us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297166.783626:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789297166.787535:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957141888:0@lo:501: 00000100:00100000:1.0:1789297166.787632:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142016:0@lo:503: 00000100:00100000:1.0:1789297166.787741:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297166.787793:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11da03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297166.788513:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142016 00000100:00100000:2.0:1789297166.788523:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142016 00000100:00100000:2.0:1789297166.788591:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789297166.788601:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957142016:12345-0@lo:503: 00000100:00100000:2.0:1789297166.788996:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957142016:12345-0@lo:503: Request processed in 396us (1255us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297166.789005:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789297166.790162:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142016:0@lo:503: 00000100:00100000:1.0:1789297166.790921:0:7156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7156:1876213957142144:0@lo:502: 00000100:00100000:1.0:1789297166.790989:0:7156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297166.791045:0:7156:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b055eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.791192:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142144 00000100:00100000:3.0:1789297166.791209:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142144 00000100:00100000:3.0:1789297166.791607:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789297166.791619:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7156:x1876213957142144:12345-0@lo:502: 00000100:00100000:3.0:1789297166.791965:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7156:x1876213957142144:12345-0@lo:502: Request processed in 347us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.791974:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789297166.792277:0:7156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7156:1876213957142144:0@lo:502: 00000100:00100000:1.0:1789297166.792742:0:7156:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7156:1876213957142272:0@lo:502: 00000100:00100000:1.0:1789297166.792793:0:7156:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297166.792834:0:7156:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b055eb6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.792898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142272 00000100:00100000:3.0:1789297166.792905:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142272 00000100:00100000:3.0:1789297166.792989:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789297166.792998:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7156:x1876213957142272:12345-0@lo:502: 00000100:00100000:3.0:1789297166.793213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7156:x1876213957142272:12345-0@lo:502: Request processed in 215us (419us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.793230:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789297166.793333:0:7156:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7156:1876213957142272:0@lo:502: 00000040:00080000:1.0:1789297166.793355:0:7156:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:0.0:1789297166.793486:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:0.0:1789297166.793515:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789297166.793526:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.793539:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297166.793549:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789297166.793552:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b07359800 from 4 10000000:01000000:0.0:1789297166.793555:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789297166.793586:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.793595:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.793606:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297166.796317:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142400:0@lo:101: 00000100:00100000:0.0:1789297166.796422:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.798297:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78180 going to sleep for 11 seconds 00000100:00100000:2.0:1789297166.802739:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142400 00000100:00100000:2.0:1789297166.802758:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142400 00000100:00100000:2.0:1789297166.802835:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789297166.802847:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957142400:12345-0@lo:101: 00010000:00010000:2.0:1789297166.802870:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297166.802897:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b291 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297166.802930:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297166.802967:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297166.802977:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20063000, rc 0) 00000100:00100000:2.0:1789297166.805734:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957142400:12345-0@lo:101: Request processed in 2877us (9299us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297166.805749:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789297166.805837:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142400:0@lo:101: 00010000:00010000:0.0:1789297166.805870:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.805924:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297166.806002:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142528:0@lo:256: 00000100:00100000:0.0:1789297166.806052:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.806095:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78180 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.806130:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142528 00000100:00100000:3.0:1789297166.806139:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142528 00000100:00100000:3.0:1789297166.806193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1789297166.806213:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957142528:12345-0@lo:256: 20000000:01000000:3.0:1789297166.806248:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789297166.806267:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789297166.806270:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:3.0:1789297166.806600:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957142528:12345-0@lo:256: Request processed in 389us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.806609:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789297166.806639:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142528:0@lo:256: 10000000:01000000:1.0:1789297166.806694:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789297166.806770:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297166.806781:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297166.807320:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789297166.807326:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:0.0:1789297166.807329:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789297166.807362:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.807371:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.807382:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297166.807399:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142656:0@lo:101: 00000100:00100000:0.0:1789297166.807472:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.807502:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78780 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.807599:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142656 00000100:00100000:3.0:1789297166.807607:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142656 00000100:00100000:3.0:1789297166.807652:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789297166.807661:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957142656:12345-0@lo:101: 00010000:00010000:3.0:1789297166.807673:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297166.807687:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b29f expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297166.807730:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297166.807741:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 15 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297166.807749:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b400, rc 0) 00000100:00100000:3.0:1789297166.807783:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957142656:12345-0@lo:101: Request processed in 122us (310us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.807801:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789297166.808411:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142656:0@lo:101: 00010000:00010000:0.0:1789297166.808438:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.808449:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297166.808535:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142784:0@lo:501: 00000100:00100000:0.0:1789297166.808569:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.808605:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78780 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.808781:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142784 00000100:00100000:3.0:1789297166.808786:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142784 00000100:00100000:3.0:1789297166.808836:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:3.0:1789297166.808844:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957142784:12345-0@lo:501: 00000100:00100000:3.0:1789297166.809386:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957142784:12345-0@lo:501: Request processed in 541us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.809393:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789297166.809489:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142784:0@lo:501: 00000100:00100000:0.0:1789297166.809531:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142912:0@lo:503: 00000100:00100000:0.0:1789297166.809572:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.809606:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78780 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.809733:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957142912 00000100:00100000:3.0:1789297166.809738:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957142912 00000100:00100000:3.0:1789297166.809773:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789297166.809781:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957142912:12345-0@lo:503: 00000100:00100000:3.0:1789297166.810120:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957142912:12345-0@lo:503: Request processed in 339us (546us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.810257:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789297166.810357:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957142912:0@lo:503: 00000100:00100000:0.0:1789297166.811052:0:7157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7157:1876213957143040:0@lo:502: 00000100:00100000:0.0:1789297166.811095:0:7157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.811220:0:7157:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789297166.811285:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143040 00000100:00100000:2.0:1789297166.811291:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143040 00000100:00100000:2.0:1789297166.811332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:2.0:1789297166.811341:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7157:x1876213957143040:12345-0@lo:502: 00000100:00100000:2.0:1789297166.811587:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7157:x1876213957143040:12345-0@lo:502: Request processed in 246us (490us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297166.811594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:0.0:1789297166.811738:0:7157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7157:1876213957143040:0@lo:502: 00000020:01000000:0.0:1789297166.811766:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1789297166.811773:0:7157:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:0.0:1789297166.811780:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297166.811783:0:7157:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:0.0:1789297166.811788:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:0.0:1789297166.811792:0:7157:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:0.0:1789297166.811880:0:7157:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:0.0:1789297166.811883:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1789297166.811897:0:7157:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff982b40b40000) 00000020:00000080:0.0:1789297166.811915:0:7157:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:0.0:1789297166.811919:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:0.0:1789297166.811986:0:7157:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:0.0:1789297166.811991:0:7157:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:0.0:1789297166.812004:0:7157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0b2b4 00010000:00080000:0.0:1789297166.812035:0:7157:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982b121d3800@lustre-OST0000-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789297166.812413:0:7157:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:0.0:1789297166.884504:0:7157:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:0.0:1789297166.884528:0:7157:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:0.0:1789297166.885304:0:7157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297166.885522:0:7157:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297166.885578:0:7157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:0.0:1789297166.885649:0:7157:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:0.0:1789297166.886692:0:7160:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789297166.886699:0:7160:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1789297166.887477:0:7157:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789297166.887498:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789297166.887534:0:7157:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1789297166.887563:0:7157:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0b2bb 00000100:00080000:0.0:1789297166.887577:0:7157:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789297166.887584:0:7157:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982b121d3800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789297166.887628:0:7157:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b41e15c00 x1876213957143168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789297166.887660:0:7157:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:0.0:1789297166.887777:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297166.887781:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297166.887783:0:7157:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:0.0:1789297166.887786:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297166.887790:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297166.887792:0:7157:0:(obd_config.c:1563:class_process_config()) marker 16 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789297166.887794:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789297166.887796:0:7157:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789297166.887826:0:7157:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7157:1876213957143296:0@lo:502: 00000100:00100000:0.0:1789297166.887912:0:7157:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.887976:0:7157:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297166.888003:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143296 00000100:00100000:0.0:1789297166.888010:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143296 00000100:00100000:1.0:1789297166.888155:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957143168:0@lo:8: 00000100:00100000:1.0:1789297166.888195:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297166.888353:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957143424:0@lo:400: 00000100:00100000:2.0:1789297166.888384:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297166.888420:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957143552:0@lo:400: 00000100:00100000:2.0:1789297166.888455:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297166.888489:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143424 00000100:00100000:2.0:1789297166.888492:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143424 00000100:00100000:2.0:1789297166.888527:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143552 00000100:00100000:2.0:1789297166.888529:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143552 00000100:00100000:2.0:1789297166.888554:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297166.888561:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957143424:12345-0@lo:400: 00000100:00100000:2.0:1789297166.888612:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957143424:12345-0@lo:400: Request processed in 50us (225us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297166.888630:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297166.888648:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789297166.888655:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957143552:12345-0@lo:400: 00000100:00100000:2.0:1789297166.888689:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957143552:12345-0@lo:400: Request processed in 34us (232us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297166.888695:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789297166.888761:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee4a80 x1876213957143424/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297166.888776:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957143424:0@lo:400: 00010000:00080000:2.0:1789297166.888804:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee5f80 x1876213957143552/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297182 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297166.888812:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957143552:0@lo:400: 00000100:00100000:0.0:1789297166.888936:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789297166.888945:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7157:x1876213957143296:12345-0@lo:502: 00000100:00100000:0.0:1789297166.889337:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7157:x1876213957143296:12345-0@lo:502: Request processed in 393us (1425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297166.889344:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:0.0:1789297166.889387:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297166.889410:0:7157:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7157:1876213957143296:0@lo:502: 00000020:01000000:0.0:1789297166.889449:0:7157:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297166.889456:0:7157:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297166.889458:0:7157:0:(obd_config.c:1563:class_process_config()) marker 16 (0x2) lustre sys.timeout 00000040:00080000:0.0:1789297166.889463:0:7157:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:0.0:1789297166.889600:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:0.0:1789297166.889618:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789297166.889629:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.889640:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297166.889651:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789297166.889654:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982b18368000 from 1 10000000:01000000:0.0:1789297166.889657:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789297166.889686:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.889695:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.889744:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297166.889761:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957143680:0@lo:101: 00000100:00100000:0.0:1789297166.889794:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.889821:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297166.889836:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143680 00000100:00100000:0.0:1789297166.889841:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143680 00000100:00100000:0.0:1789297166.889865:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789297166.889872:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957143680:12345-0@lo:101: 00010000:00010000:0.0:1789297166.889881:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297166.889894:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b2c2 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.889918:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.889930:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.889938:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031e00, rc 0) 00000100:00100000:0.0:1789297166.889963:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957143680:12345-0@lo:101: Request processed in 91us (168us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297166.889968:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789297166.889994:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957143680:0@lo:101: 00010000:00010000:0.0:1789297166.890005:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.890302:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297166.890356:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957143808:0@lo:501: 00000100:00100000:0.0:1789297166.890382:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.890406:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad5840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297166.890418:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143808 00000100:00100000:0.0:1789297166.890422:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143808 00000100:00100000:0.0:1789297166.890450:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789297166.890455:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957143808:12345-0@lo:501: 00000100:00100000:0.0:1789297166.890683:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957143808:12345-0@lo:501: Request processed in 226us (298us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789297166.890690:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789297166.890747:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957143808:0@lo:501: 10000000:01000000:0.0:1789297166.890770:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:0.0:1789297166.890775:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297166.890783:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297166.891266:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143168 00000100:00100000:3.0:1789297166.891274:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143168 00000100:00100000:3.0:1789297166.891347:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297166.891355:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876213957143168:12345-0@lo:8: 00010000:00080000:3.0:1789297166.891383:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 178 last 0 00000020:00000080:3.0:1789297166.891413:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0b2d0 00002000:00100000:3.0:1789297166.891474:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff982a01708800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789297166.891479:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:3.0:1789297166.891484:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789297166.891604:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789297166.891812:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789297166.891859:0:6687:0:(import.c:65:import_set_state_nolock()) ffff982a0170e800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789297166.891937:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876213957143168:12345-0@lo:8: Request processed in 581us (3739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.891945:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789297166.892104:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e15c00 x1876213957143168/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789297176 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297166.892118:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1789297166.892302:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1789297166.892313:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1789297166.892328:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1789297166.892331:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b121d3800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1789297166.892360:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1789297166.892367:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957143168:0@lo:8: 00000004:00080000:0.0:1789297166.892399:0:7160:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:0.0:1789297166.892528:0:7160:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 178766823239ns, next at 0ns, rc = 0 00000004:00080000:3.0:1789297166.931940:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789297166.950650:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957143936:0@lo:13: 00000100:00100000:0.0:1789297166.950755:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297166.950907:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957143936 00000100:00100000:3.0:1789297166.950916:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957143936 00000100:00100000:3.0:1789297166.950994:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297166.951005:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957143936:12345-0@lo:13: 00002000:00000024:3.0:1789297166.951061:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00080000:1.0:1789297166.951144:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000004:00080000:2.0:1789297166.951313:0:7162:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789297166.951339:0:7162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144064:0@lo:7: 00000100:00100000:2.0:1789297166.951375:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297166.951396:0:7162:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b055eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.951519:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957143936:12345-0@lo:13: Request processed in 514us (763us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.951527:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297166.951556:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144064 00000100:00100000:3.0:1789297166.951560:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144064 00000100:00100000:3.0:1789297166.951594:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297166.951602:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7162:x1876213957144064:12345-0@lo:7: 00010000:00080000:0.0:1789297166.955348:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee5f80 x1876213957143936/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297166.955385:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957143936:0@lo:13: 00002000:00080000:3.0:1789297166.957410:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:3.0:1789297166.957419:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:3.0:1789297166.957621:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7162:x1876213957144064:12345-0@lo:7: Request processed in 6015us (6240us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297166.957632:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789297166.957991:0:7162:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee4a80 x1876213957144064/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789297182 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297166.958338:0:7162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144064:0@lo:7: 00000004:00080000:2.0:1789297166.958353:0:7162:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:2.0:1789297166.958393:0:7162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144192:0@lo:5: 00000100:00100000:2.0:1789297166.958448:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297166.958540:0:7162:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b055eb3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297166.958622:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144192 00000100:00100000:3.0:1789297166.958629:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144192 00000100:00100000:3.0:1789297166.958697:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297166.958725:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:7162:x1876213957144192:12345-0@lo:5: 00002000:00080000:3.0:1789297166.958754:0:6687:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1789297166.958757:0:6687:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1789297166.959108:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:7162:x1876213957144192:12345-0@lo:5: Request processed in 403us (659us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789297166.959201:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1789297166.959242:0:7162:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee4a80 x1876213957144192/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789297182 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297166.959257:0:7162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144192:0@lo:5: 00000004:00080000:2.0:1789297166.959266:0:7162:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:2.0:1789297166.959288:0:7162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144320:0@lo:700: 00000100:00100000:2.0:1789297166.959309:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297166.959363:0:7162:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b055eb3c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297166.959471:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144320 00000100:00100000:0.0:1789297166.959476:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144320 00000100:00100000:0.0:1789297166.959504:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789297166.959513:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7162:x1876213957144320:12345-0@lo:700: 00000100:00100000:0.0:1789297166.959541:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876213957144448:0@lo:700: 00000100:00100000:0.0:1789297166.959568:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297166.959586:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b053049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297166.959610:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144448 00000100:00100000:1.0:1789297166.959619:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144448 00000100:00100000:1.0:1789297166.959653:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789297166.959660:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876213957144448:12345-0@lo:700: 40000000:02000000:2.0:1789297166.981360:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1789297166.986064:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6695:x1876213957144448:12345-0@lo:700: Request processed in 26396us (26485us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297166.986084:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1789297166.986095:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e16d80 x1876213957144448/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789297182 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297166.986110:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6695:1876213957144448:0@lo:700: 40000000:02000000:0.0:1789297166.986123:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00080000:2.0:1789297167.038666:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000001:00100000:2.0:1789297167.038683:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1789297167.038730:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7162:x1876213957144320:12345-0@lo:700: Request processed in 79213us (79413us total) trans 0 rc 0/0 00010000:00080000:2.0:1789297167.038743:0:7162:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee7800 x1876213957144320/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789297182 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297167.038746:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297167.038759:0:7162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144320:0@lo:700: 00000004:02000040:2.0:1789297167.059588:0:7162:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:3.0:1789297167.065343:0:7162:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144576:0@lo:5: 00000100:00100000:3.0:1789297167.065437:0:7162:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297167.065569:0:7162:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07361780 going to sleep for 11 seconds 00000100:00100000:0.0:1789297167.066505:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144576 00000100:00100000:0.0:1789297167.066517:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144576 00000100:00100000:0.0:1789297167.066641:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789297167.066653:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:7162:x1876213957144576:12345-0@lo:5: 00002000:00080000:1.0:1789297167.077215:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:1.0:1789297167.077238:0:6689:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:1.0:1789297167.081749:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7162:x1876213957144576:12345-0@lo:5: Request processed in 15091us (16304us total) trans 4294967298 rc 0/0 00000100:00100000:1.0:1789297167.081767:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789297167.081938:0:7162:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b11f55c00 x1876213957144576/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789297183 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297167.081954:0:7162:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:3.0:1789297167.081971:0:7162:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982b11f55c00 x1876213957144576/t4294967298(4294967298) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789297183 ref 3 fl Rpc:RQU/204/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297167.081982:0:7162:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:7162:1876213957144576:0@lo:5: 00000004:00080000:3.0:1789297167.081998:0:7162:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:2.0:1789297167.818233:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297168.828902:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297169.860018:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789297170.272211:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:0.0:1789297170.878816:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297171.906362:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297171.911878:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957144704:0@lo:400: 00000100:00100000:3.0:1789297171.911969:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297171.912226:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789297171.912233:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957144832:0@lo:400: 00000100:00100000:1.0:1789297171.912238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144704 00000100:00100000:1.0:1789297171.912246:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144704 00000100:00100000:3.0:1789297171.912261:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297171.912418:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957144960:0@lo:400: 00000100:00100000:0.0:1789297171.912450:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297171.912471:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297171.912476:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957145088:0@lo:400: 00000100:00100000:0.0:1789297171.912501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297171.912532:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145088 00000100:00100000:0.0:1789297171.912536:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145088 00000100:00100000:0.0:1789297171.912583:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789297171.912592:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957145088:12345-0@lo:400: 00000100:00100000:0.0:1789297171.912645:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957145088:12345-0@lo:400: Request processed in 54us (143us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297171.912652:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789297171.912672:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789297171.912701:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e15180 x1876213957145088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297171.912732:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:0.0:1789297171.912747:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957145088:0@lo:400: 00000100:00100000:2.0:1789297171.913480:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144832 00000100:00100000:2.0:1789297171.913488:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144832 00000100:00100000:2.0:1789297171.913534:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957144960 00000100:00100000:2.0:1789297171.913537:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957144960 00000100:00100000:2.0:1789297171.913570:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789297171.913578:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957144832:12345-0@lo:400: 00000100:00100000:2.0:1789297171.913650:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957144832:12345-0@lo:400: Request processed in 72us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297171.913657:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789297171.913672:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789297171.913678:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957144960:12345-0@lo:400: 00000100:00100000:2.0:1789297171.913730:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957144960:12345-0@lo:400: Request processed in 52us (1279us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297171.913736:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:2.0:1789297171.913773:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e17100 x1876213957144960/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297171.913784:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957144960:0@lo:400: 00010000:00080000:2.0:1789297171.913814:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e17800 x1876213957144832/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297187 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297171.913823:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957144832:0@lo:400: 00000100:00100000:1.0:1789297171.914134:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789297171.914146:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:3302:x1876213957144704:12345-0@lo:400: 00000100:00100000:1.0:1789297171.914185:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:3302:x1876213957144704:12345-0@lo:400: Request processed in 45us (2216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297171.914192:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00080000:0.0:1789297171.914414:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297171.914478:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957144704:0@lo:400: 00000100:00100000:2.0:1789297172.414967:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789297172.415004:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957145216:0@lo:13: 00000100:00100000:2.0:1789297172.415084:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297172.415255:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145216 00000100:00100000:2.0:1789297172.415262:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145216 00000100:00100000:2.0:1789297172.415310:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297172.415320:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957145216:12345-0@lo:13: 00002000:00000024:2.0:1789297172.415357:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297172.415414:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957145216:12345-0@lo:13: Request processed in 95us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297172.415433:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1789297172.415476:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ee7800 x1876213957145216/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297172.415495:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957145216:0@lo:13: 00010000:00010000:0.0:1789297172.925813:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297173.952310:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297174.978032:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297176.002776:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789297176.216841:0:7627:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789297176.216845:0:7627:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:1.0:1789297176.217134:0:7627:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982a01db8800 00000020:01000004:1.0:1789297176.217150:0:7627:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1789297176.217163:0:7627:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:1.0:1789297176.217186:0:7627:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff982b40cab370) 00000020:00000080:1.0:1789297176.217204:0:7627:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:1.0:1789297176.233557:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:1.0:1789297176.233839:0:7627:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1789297176.255924:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1789297176.261073:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789297176.261106:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1789297176.261161:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789297176.261189:0:7627:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1789297176.261538:0:7627:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789297176.261551:0:7627:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789297176.261561:0:7627:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ad177e823a0b2de 00000020:01000004:2.0:1789297176.261568:0:7627:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789297176.261590:0:7627:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789297176.261594:0:7627:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789297176.261599:0:7627:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789297176.261618:0:7627:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789297176.261622:0:7627:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1789297176.287270:0:7627:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789297176.287465:0:7627:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.143@tcp, index=0001, flags=0x20062 00000020:01000004:3.0:1789297176.287470:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789297176.287471:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789297176.287473:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297176.287474:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297176.287479:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297176.287481:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297176.287482:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789297176.287483:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789297176.287485:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789297176.287486:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297176.287488:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789297176.287493:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:3.0:1789297176.287495:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789297176.287497:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789297176.287498:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297176.287499:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297176.287499:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297176.287500:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297176.287501:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789297176.287502:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789297176.287503:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789297176.287504:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297176.287505:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789297176.287549:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789297176.287570:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957145344:0@lo:253: 00000100:00100000:3.0:1789297176.287648:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297176.287825:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11ae56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297176.288255:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145344 00000100:00100000:0.0:1789297176.288265:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145344 00000100:00100000:0.0:1789297176.288371:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789297176.288382:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:7627:x1876213957145344:12345-0@lo:253: 20000000:01000000:0.0:1789297176.288417:0:5835:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1789297176.288422:0:5835:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1789297176.288436:0:5835:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1789297176.288439:0:5835:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1789297176.292395:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297176.292596:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:0.0:1789297176.292611:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:0.0:1789297176.292642:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:0.0:1789297176.292649:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:0.0:1789297176.292672:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:0.0:1789297176.292738:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:0.0:1789297176.293469:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:0.0:1789297176.293493:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:0.0:1789297176.293496:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:0.0:1789297176.293528:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:0.0:1789297176.293535:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:0.0:1789297176.293578:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:0.0:1789297176.293586:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:0.0:1789297176.293615:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:0.0:1789297176.293624:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:0.0:1789297176.293652:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:0.0:1789297176.293694:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1789297176.297317:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1789297176.297364:0:5835:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.202.143@tcp 20000000:01000000:1.0:1789297176.297367:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.202.143@tcp (null) (null) (null) 00000040:00080000:1.0:1789297176.297403:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1789297176.297411:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1789297176.297440:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1789297176.297458:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.202.143@tcp (null) (null) 00000040:00080000:1.0:1789297176.297506:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1789297176.297516:0:5835:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1789297176.297562:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1789297176.297601:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1789297176.297619:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' sys.timeout=20 ', param: 'autodegrade=on' 20000000:01000000:1.0:1789297176.297622:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 20000000:01000000:1.0:1789297176.297628:0:5835:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'sys.timeout=20' 20000000:01000000:1.0:1789297176.297629:0:5835:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1789297176.297631:0:5835:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1789297176.297643:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1789297176.297645:0:5835:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1789297176.297679:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1789297176.297681:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789297176.299611:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 14 1->4: lustre sys.timeout 20000000:01000000:3.0:1789297176.299687:0:7629:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 14 2->4: lustre sys.timeout 00000040:00080000:3.0:1789297176.299922:0:7629:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:1.0:1789297176.300691:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:1.0:1789297176.300880:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:1.0:1789297176.300915:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:1.0:1789297176.300928:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1789297176.300930:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789297176.302138:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:3.0:1789297176.302221:0:7630:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:3.0:1789297176.302255:0:7630:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1789297176.302669:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1789297176.302749:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1789297176.302819:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1789297176.302832:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1789297176.302834:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:3.0:1789297176.303841:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 16 1->4: lustre sys.timeout 20000000:01000000:3.0:1789297176.303897:0:7631:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 16 2->4: lustre sys.timeout 00000040:00080000:3.0:1789297176.303957:0:7631:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1789297176.304438:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1789297176.304475:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1789297176.304539:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1789297176.304552:0:5835:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1789297176.304554:0:5835:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:3.0:1789297176.305263:0:7632:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1789297176.305469:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1789297176.305509:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1789297176.305580:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 10000000:01000000:1.0:1789297176.305598:0:5835:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1789297176.305622:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.305641:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.305649:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.305655:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.305660:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.305666:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.305675:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.306909:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.306927:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 16 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297176.307006:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145472:0@lo:104: 00000100:00100000:1.0:1789297176.307248:0:5835:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789297176.307375:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.307400:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 16 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297176.307410:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145600:0@lo:104: 00010000:00010000:1.0:1789297176.307438:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.307445:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 16 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297176.307453:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145728:0@lo:104: 00010000:00010000:1.0:1789297176.307473:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.307480:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 16 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297176.307488:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145856:0@lo:104: 00010000:00010000:1.0:1789297176.307509:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.307517:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 16 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297176.307524:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145984:0@lo:104: 00000100:00100000:1.0:1789297176.307540:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c533c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.307605:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789297176.307624:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.307682:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.307790:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297176.307898:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145472 00000100:00100000:1.0:1789297176.307906:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145472 00000100:00100000:1.0:1789297176.307961:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145600 00000100:00100000:1.0:1789297176.307964:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145600 00000100:00100000:1.0:1789297176.307976:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145728 00000100:00100000:1.0:1789297176.307978:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145728 00000100:00100000:1.0:1789297176.307991:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297176.307999:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:5835:x1876213957145472:12345-0@lo:104: 00010000:00010000:1.0:1789297176.308023:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.308299:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789297176.308307:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06257050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:5835:x1876213957145472:12345-0@lo:104: Request processed in 307us (1058us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.308314:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297176.308390:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789297176.308397:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:5835:x1876213957145600:12345-0@lo:104: 00010000:00010000:1.0:1789297176.308405:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.308445:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789297176.308449:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:5835:x1876213957145600:12345-0@lo:104: Request processed in 54us (826us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.308455:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789297176.308467:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789297176.308473:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5835:x1876213957145728:12345-0@lo:104: 00010000:00010000:1.0:1789297176.308480:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.308506:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789297176.308516:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5835:x1876213957145728:12345-0@lo:104: Request processed in 44us (834us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.308522:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:0.0:1789297176.308656:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789297176.308664:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.308672:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00030400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297176.308676:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.308685:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297176.308692:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297176.308723:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789297176.308881:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.308888:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297176.308915:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.308922:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b2c2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b2c9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.308993:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789297176.308997:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309003:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031a00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297176.309006:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309011:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297176.309182:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297176.309188:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789297176.309208:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309215:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297176.309237:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309243:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b00031a00/0x8ad177e823a0b29f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b2a6 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309253:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297176.309256:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309262:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b42176600 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297176.309264:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309270:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297176.309275:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297176.309279:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1789297176.309293:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309297:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297176.309302:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309308:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b42176600/0x8ad177e823a0b283 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b28a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309316:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297176.309323:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297176.309324:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297176.309334:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789297176.309361:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957146112:0@lo:103: 00000100:00100000:0.0:1789297176.309405:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.309450:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957146240:0@lo:103: 00000100:00100000:0.0:1789297176.309471:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.309488:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297176.309494:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957146368:0@lo:103: 00000100:00100000:0.0:1789297176.309513:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.309550:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957146112 00000100:00100000:0.0:1789297176.309556:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957146112 00010000:00010000:0.0:1789297176.309578:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 17 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.309595:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957146240 00000100:00100000:0.0:1789297176.309598:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957146240 00010000:00010000:0.0:1789297176.309606:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 18 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.309614:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957146368 00000100:00100000:0.0:1789297176.309615:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957146368 00010000:00010000:0.0:1789297176.309621:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 19 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.309628:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789297176.309632:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957146112:12345-0@lo:103: 00010000:00010000:0.0:1789297176.309641:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297176.309645:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 19 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309661:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 19 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.309676:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297176.309698:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957146112:12345-0@lo:103: Request processed in 65us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.311055:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:1.0:1789297176.311079:0:5826:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00010000:00010000:3.0:1789297176.311255:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b2c9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b2c2 expref: 19 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297176.311289:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5f80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145472:0@lo:104: 00010000:00010000:3.0:1789297176.311302:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297176.311320:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7800 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145600:0@lo:104: 00000100:00100000:3.0:1789297176.311328:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef4e00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145728:0@lo:104: 00000100:00100000:2.0:1789297176.311443:0:5824:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.311459:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145856 00000100:00100000:2.0:1789297176.311465:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145856 00000100:00100000:2.0:1789297176.311504:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957145984 00000100:00100000:2.0:1789297176.311507:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957145984 00000100:00100000:2.0:1789297176.311519:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789297176.311527:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:5835:x1876213957145856:12345-0@lo:104: 00010000:00010000:2.0:1789297176.311541:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.311610:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789297176.311616:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:5835:x1876213957145856:12345-0@lo:104: Request processed in 90us (3825us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.311622:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:2.0:1789297176.311640:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297176.311645:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.311652:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031600 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297176.311655:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.311662:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297176.311670:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297176.311676:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789297176.311739:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.311745:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789297176.311856:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789297176.311864:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5835:x1876213957145984:12345-0@lo:104: 00010000:00010000:1.0:1789297176.311871:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.311903:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789297176.311909:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5835:x1876213957145984:12345-0@lo:104: Request processed in 47us (467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.311913:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1789297176.312203:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789297176.312228:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145856:0@lo:104: 00000100:00100000:3.0:1789297176.312237:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef4700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5835:1876213957145984:0@lo:104: 00010000:00010000:3.0:1789297176.312267:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297176.312545:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297176.312554:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:3304:x1876213957146240:12345-0@lo:103: 00010000:00010000:3.0:1789297176.312566:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297176.312573:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 18 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.312584:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 18 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.312598:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b2a6 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b29f expref: 18 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.312612:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297176.312655:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:3304:x1876213957146240:12345-0@lo:103: Request processed in 103us (3184us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.312662:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297176.312687:0:5826:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:3.0:1789297176.312700:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1789297176.312729:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:3304:x1876213957146368:12345-0@lo:103: 00010000:00010000:3.0:1789297176.312736:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297176.312739:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 16 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.312748:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 16 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.312857:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789297176.312896:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957146240:0@lo:103: 00000100:00100000:0.0:1789297176.312925:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957146112:0@lo:103: 00010000:00010000:1.0:1789297176.313109:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297176.313121:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297176.313123:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297176.313223:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152ba00/0x8ad177e823a0b28a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b283 expref: 15 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.313233:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297176.313275:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3304:x1876213957146368:12345-0@lo:103: Request processed in 548us (3760us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.313282:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00010000:3.0:1789297176.313302:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.313311:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152aa00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297176.313316:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.313325:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297176.313332:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297176.313360:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789297176.313385:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.313391:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:1.0:1789297176.313448:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957146368:0@lo:103: 00010000:00010000:2.0:1789297176.313631:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.313639:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b00031600/0x8ad177e823a0b259 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b260 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.313651:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297176.313653:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297176.313655:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297176.313738:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957146496:0@lo:103: 00000100:00100000:1.0:1789297176.313787:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.313869:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957146496 00000100:00100000:2.0:1789297176.313875:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957146496 00010000:00010000:2.0:1789297176.313896:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297176.313915:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789297176.313922:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3302:x1876213957146496:12345-0@lo:103: 00010000:00010000:2.0:1789297176.313930:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297176.313934:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.313954:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.313964:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b260 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b259 expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.313974:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297176.314127:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.314134:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152aa00/0x8ad177e823a0b22f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b236 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.314151:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297176.314153:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297176.314155:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297176.314166:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957146624:0@lo:103: 00000100:00100000:3.0:1789297176.314204:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.314685:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789297176.314695:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957146624 00000100:00100000:0.0:1789297176.314699:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957146624 00010000:00010000:0.0:1789297176.314729:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 14 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.314745:0:5828:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:0.0:1789297176.314805:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789297176.314816:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3303:x1876213957146624:12345-0@lo:103: 00010000:00010000:0.0:1789297176.314825:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297176.314830:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 14 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314840:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 14 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314851:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062800/0x8ad177e823a0b236 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b22f expref: 14 pid: 5835 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314876:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314883:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314895:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314902:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314907:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314913:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314918:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b42176400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297176.314922:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.314929:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.315001:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.315011:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297176.315178:0:5835:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.315197:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.315203:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42176400/0x8ad177e823a0b2e5 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:0.0:1789297176.315217:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789297176.316287:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:3302:x1876213957146496:12345-0@lo:103: Request processed in 2354us (2488us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.316298:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789297176.320571:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3303:x1876213957146624:12345-0@lo:103: Request processed in 5748us (6356us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297176.320586:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789297176.321096:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957146496:0@lo:103: 00000100:00100000:2.0:1789297176.321619:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957146624:0@lo:103: 00000100:00100000:0.0:1789297176.369235:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:7627:x1876213957145344:12345-0@lo:253: Request processed in 80847us (81578us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297176.369251:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789297176.369373:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957145344:0@lo:253: 10000000:01000000:2.0:1789297176.369389:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:2.0:1789297176.369392:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1789297176.369394:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789297176.369395:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789297176.369396:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:2.0:1789297176.369397:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789297176.369398:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789297176.369400:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789297176.369401:0:7627:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:2.0:1789297176.369403:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789297176.369404:0:7627:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:2.0:1789297176.369424:0:7627:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982a01db8800 from lustre-OST0001 10000000:01000000:2.0:1789297176.369449:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:2.0:1789297176.369452:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789297176.369461:0:7627:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982b18368000 local copy 10000000:01000000:2.0:1789297176.369465:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1789297176.369512:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.369524:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.369534:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297176.369564:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957146752:0@lo:101: 00000100:00100000:2.0:1789297176.369601:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.369655:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05798600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297176.369783:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957146752 00000100:00100000:0.0:1789297176.369790:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957146752 00000100:00100000:0.0:1789297176.369831:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789297176.369840:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+11:7627:x1876213957146752:12345-0@lo:101: 00010000:00010000:0.0:1789297176.369855:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297176.369870:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b2f3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b2ec expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.369892:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b2ec expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.369903:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b2f3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b2ec expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.369912:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031a00, rc 0) 00000100:00100000:0.0:1789297176.370085:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:7627:x1876213957146752:12345-0@lo:101: Request processed in 245us (483us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297176.370093:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789297176.370285:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957146752:0@lo:101: 00010000:00010000:2.0:1789297176.370298:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.370313:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297176.370439:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957146880:0@lo:501: 00000100:00100000:2.0:1789297176.370466:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.370494:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05798600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297176.370556:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957146880 00000100:00100000:0.0:1789297176.370561:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957146880 00000100:00100000:0.0:1789297176.370591:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789297176.370599:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:7627:x1876213957146880:12345-0@lo:501: 00000100:00100000:0.0:1789297176.371057:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:7627:x1876213957146880:12345-0@lo:501: Request processed in 457us (588us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789297176.371212:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957146880:0@lo:501: 10000000:01000000:2.0:1789297176.371228:0:7627:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1789297176.371256:0:7627:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1789297176.371263:0:7627:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371271:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371278:0:7627:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371297:0:7627:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1789297176.371320:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982a01db8800 10000000:01000000:2.0:1789297176.371325:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789297176.371330:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1789297176.371332:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789297176.371345:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1789297176.371348:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789297176.371368:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371385:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371395:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297176.371409:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147008:0@lo:101: 00000100:00100000:2.0:1789297176.371438:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.371460:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b057983c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.371475:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147008 00000100:00100000:2.0:1789297176.371480:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147008 00000100:00100000:2.0:1789297176.371507:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789297176.371514:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147008:12345-0@lo:101: 00010000:00010000:2.0:1789297176.371521:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297176.371531:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b2fa expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371558:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371568:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371575:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20062400, rc 0) 00000100:00100000:2.0:1789297176.371603:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957147008:12345-0@lo:101: Request processed in 89us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.371609:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789297176.371645:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147008:0@lo:101: 00010000:00010000:2.0:1789297176.371664:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.371672:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297176.371748:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147136:0@lo:501: 00000100:00100000:2.0:1789297176.371894:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.371911:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399ed3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.371924:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147136 00000100:00100000:2.0:1789297176.371927:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147136 00000100:00100000:2.0:1789297176.372012:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789297176.372020:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957147136:12345-0@lo:501: 00000100:00100000:0.0:1789297176.372210:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789297176.372396:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147136:12345-0@lo:501: Request processed in 376us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.372402:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00010000:00010000:2.0:1789297176.372426:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297176.372433:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.372441:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063a00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297176.372446:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.372455:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297176.372462:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297176.372479:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1789297176.372502:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.372508:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297176.372528:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.372533:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b2ec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x8ad177e823a0b2f3 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.372863:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147136:0@lo:501: 00000100:00100000:0.0:1789297176.372892:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147392:0@lo:503: 00000100:00100000:0.0:1789297176.372934:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.373030:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789297176.373045:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147392 00000100:00100000:0.0:1789297176.373049:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147392 00000100:00100000:0.0:1789297176.373090:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789297176.373096:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147392:12345-0@lo:503: 00000100:00100000:0.0:1789297176.373356:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147392:12345-0@lo:503: Request processed in 259us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297176.373362:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:0.0:1789297176.373402:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147392:0@lo:503: 00000100:00100000:2.0:1789297176.373615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957147264:0@lo:103: 00000100:00100000:2.0:1789297176.373644:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.373675:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147264 00000100:00100000:2.0:1789297176.373679:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147264 00000100:00100000:2.0:1789297176.373730:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297176.373738:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:3304:x1876213957147264:12345-0@lo:103: 00010000:00010000:2.0:1789297176.373748:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297176.374081:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b2f3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b2ec expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.374097:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000040:00080000:0.0:1789297176.374261:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789297176.374322:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147520:0@lo:502: 00000100:00100000:0.0:1789297176.374552:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.374587:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffb40 going to sleep for 11 seconds 00000100:00100000:3.0:1789297176.374725:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147520 00000100:00100000:3.0:1789297176.374730:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147520 00000100:00100000:3.0:1789297176.374775:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789297176.374783:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147520:12345-0@lo:502: 00000100:00100000:3.0:1789297176.375094:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147520:12345-0@lo:502: Request processed in 312us (550us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.375101:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789297176.375304:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147520:0@lo:502: 00000040:00080000:1.0:1789297176.375602:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1789297176.375653:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1789297176.375687:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1789297176.376259:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1789297176.376307:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1789297176.376699:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1789297176.376922:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147648:0@lo:502: 00000100:00100000:1.0:1789297176.377055:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297176.377204:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297176.377270:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147648 00000100:00100000:0.0:1789297176.377277:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147648 00000100:00100000:0.0:1789297176.377323:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789297176.377332:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147648:12345-0@lo:502: 00000100:00100000:0.0:1789297176.377525:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147648:12345-0@lo:502: Request processed in 194us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297176.377533:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789297176.377679:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147648:0@lo:502: 00010000:00010000:0.0:1789297176.377852:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297176.377856:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297176.377857:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297176.378040:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:1.0:1789297176.378052:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000100:00100000:2.0:1789297176.378609:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:3304:x1876213957147264:12345-0@lo:103: Request processed in 4870us (4963us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.378619:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789297176.378695:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957147264:0@lo:103: 00000020:01000000:3.0:1789297176.381416:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1789297176.381431:0:7635:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1789297176.381438:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297176.381440:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1789297176.381446:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1789297176.381476:0:7635:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff982a01700000) 00000020:00000080:3.0:1789297176.381499:0:7635:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1789297176.381506:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1789297176.381648:0:7635:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a01db8800 from lustre-OST0001, refs=2 00080000:01000000:3.0:1789297176.381656:0:7635:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:3.0:1789297176.381662:0:7635:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ad177e823a0b30f 00010000:00010000:3.0:1789297176.389449:0:7635:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1789297176.390275:0:7635:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:2.0:1789297176.395536:0:7635:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:2.0:1789297176.396325:0:7635:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:2.0:1789297176.403405:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:2.0:1789297176.404052:0:7635:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:2.0:1789297176.405895:0:7635:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789297176.405907:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297176.405914:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297176.405916:0:7635:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789297176.405920:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297176.405923:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297176.405925:0:7635:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789297176.405928:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789297176.405929:0:7635:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789297176.407688:0:7635:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297176.407700:0:7635:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297176.407716:0:7635:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789297176.407721:0:7635:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1789297176.411660:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:0.0:1789297176.412050:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:0.0:1789297176.412184:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.412198:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297176.412206:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a01db8800 from 1 10000000:01000000:0.0:1789297176.412209:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789297176.412253:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.412261:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.412274:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.412300:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147776:0@lo:101: 00000100:00100000:0.0:1789297176.412390:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.413641:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ff540 going to sleep for 11 seconds 00000100:00100000:3.0:1789297176.416662:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147776 00000100:00100000:3.0:1789297176.416681:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147776 00000100:00100000:3.0:1789297176.418303:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789297176.418322:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:7627:x1876213957147776:12345-0@lo:101: 00010000:00010000:3.0:1789297176.418352:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297176.418373:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b316 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.418414:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.418427:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.418438:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152aa00, rc 0) 00000100:00100000:3.0:1789297176.418529:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147776:12345-0@lo:101: Request processed in 214us (6138us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.418535:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789297176.418642:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147776:0@lo:101: 00010000:00010000:0.0:1789297176.418663:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.418672:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.418818:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147904:0@lo:501: 00000100:00100000:0.0:1789297176.419005:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.420442:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ff540 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.420649:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957147904 00000100:00100000:2.0:1789297176.420657:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957147904 00000100:00100000:2.0:1789297176.420694:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789297176.420724:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147904:12345-0@lo:501: 00000100:00100000:2.0:1789297176.421275:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957147904:12345-0@lo:501: Request processed in 571us (2267us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.421282:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:0.0:1789297176.421382:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957147904:0@lo:501: 00000100:00100000:0.0:1789297176.421431:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148032:0@lo:503: 00000100:00100000:0.0:1789297176.421478:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.421510:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ff540 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.421613:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148032 00000100:00100000:2.0:1789297176.421618:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148032 00000100:00100000:2.0:1789297176.421639:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789297176.421644:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957148032:12345-0@lo:503: 00000100:00100000:2.0:1789297176.422323:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957148032:12345-0@lo:503: Request processed in 675us (842us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.422332:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:0.0:1789297176.422624:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148032:0@lo:503: 00000040:00080000:0.0:1789297176.425322:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789297176.425433:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148160:0@lo:502: 00000100:00100000:0.0:1789297176.425529:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.425771:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ff540 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.426053:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148160 00000100:00100000:2.0:1789297176.426062:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148160 00000100:00100000:2.0:1789297176.427317:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789297176.427327:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957148160:12345-0@lo:502: 00000100:00100000:2.0:1789297176.427743:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957148160:12345-0@lo:502: Request processed in 416us (2213us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.427751:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:0.0:1789297176.427871:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148160:0@lo:502: 00000040:00080000:0.0:1789297176.428896:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:0.0:1789297176.428982:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:0.0:1789297176.429021:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148288:0@lo:502: 00000100:00100000:0.0:1789297176.429103:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.429762:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ff540 going to sleep for 11 seconds 00000100:00100000:3.0:1789297176.430030:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148288 00000100:00100000:3.0:1789297176.430039:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148288 00000100:00100000:0.0:1789297176.430236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:0.0:1789297176.430245:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957148288:12345-0@lo:502: 00000100:00100000:0.0:1789297176.430490:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957148288:12345-0@lo:502: Request processed in 245us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297176.430497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789297176.430754:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148288:0@lo:502: 00000040:00080000:3.0:1789297176.430907:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:3.0:1789297176.430931:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:0.0:1789297176.431896:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297176.431909:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297176.431912:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789297176.431918:0:7639:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a01db8800 00000020:00000080:0.0:1789297176.431921:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789297176.432041:0:7639:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297176.432046:0:7639:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297176.432048:0:7639:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1789297176.432051:0:7639:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1789297176.432684:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1789297176.432785:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789297176.432803:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.432815:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297176.433082:0:7627:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789297176.433085:0:7627:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982a01db8800 10000000:01000000:3.0:1789297176.433088:0:7627:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982a01db8800 10000000:01000000:3.0:1789297176.433092:0:7627:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789297176.433097:0:7627:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a01db8800 from 1 10000000:01000000:3.0:1789297176.433100:0:7627:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789297176.433252:0:7627:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.433262:0:7627:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.433275:0:7627:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297176.433299:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148416:0@lo:101: 00000100:00100000:3.0:1789297176.433486:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297176.433532:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11f509c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297176.433684:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148416 00000100:00100000:1.0:1789297176.433692:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148416 00000100:00100000:1.0:1789297176.433757:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789297176.433767:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957148416:12345-0@lo:101: 00010000:00010000:1.0:1789297176.433781:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297176.433793:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b324 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.433816:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.433838:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.433846:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42177800, rc 0) 00000100:00100000:1.0:1789297176.433890:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148416:12345-0@lo:101: Request processed in 124us (404us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.433898:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1789297176.434070:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148416:0@lo:101: 00010000:00010000:1.0:1789297176.434085:0:7627:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.434108:0:7627:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297176.434353:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148544:0@lo:501: 00000100:00100000:1.0:1789297176.434382:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297176.434408:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148544 00000100:00100000:1.0:1789297176.434412:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148544 00000100:00100000:1.0:1789297176.434431:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789297176.434437:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148544:12345-0@lo:501: 00000100:00100000:1.0:1789297176.434745:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148544:12345-0@lo:501: Request processed in 307us (361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.434754:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1789297176.434786:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297176.434798:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148544:0@lo:501: 00000100:00100000:1.0:1789297176.435002:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148672:0@lo:503: 00000100:00100000:1.0:1789297176.435040:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297176.435148:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.435349:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148672 00000100:00100000:2.0:1789297176.435355:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148672 00000100:00100000:2.0:1789297176.435420:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1789297176.435428:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148672:12345-0@lo:503: 00000100:00100000:2.0:1789297176.435695:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148672:12345-0@lo:503: Request processed in 268us (654us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.435759:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789297176.436398:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148672:0@lo:503: 00000040:00080000:1.0:1789297176.436919:0:7627:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1789297176.437202:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148800:0@lo:502: 00000100:00100000:1.0:1789297176.437264:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297176.437310:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789297176.437371:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148800 00000100:00100000:2.0:1789297176.437378:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148800 00000100:00100000:2.0:1789297176.437419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1789297176.437427:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148800:12345-0@lo:502: 00000100:00100000:2.0:1789297176.437781:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148800:12345-0@lo:502: Request processed in 353us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.437788:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1789297176.438026:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148800:0@lo:502: 00000040:00080000:1.0:1789297176.438435:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:1.0:1789297176.438495:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:1.0:1789297176.438529:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:1.0:1789297176.438926:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:1.0:1789297176.439037:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:1.0:1789297176.439228:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:1.0:1789297176.439290:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:1.0:1789297176.439329:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:1.0:1789297176.439398:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:1.0:1789297176.439438:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:1.0:1789297176.439467:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:1.0:1789297176.439509:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:1.0:1789297176.439540:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:1.0:1789297176.439651:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:1.0:1789297176.439698:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:1.0:1789297176.440252:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:1.0:1789297176.440292:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:1.0:1789297176.440371:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:1.0:1789297176.440411:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:1.0:1789297176.440446:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:1.0:1789297176.440493:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:1.0:1789297176.440530:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:1.0:1789297176.440642:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:1.0:1789297176.440690:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:1.0:1789297176.441044:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:1.0:1789297176.441217:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:1.0:1789297176.441267:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:1.0:1789297176.441302:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:1.0:1789297176.441345:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:1.0:1789297176.441411:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:1.0:1789297176.441448:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:1.0:1789297176.441480:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:1.0:1789297176.441510:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:1.0:1789297176.441631:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:1.0:1789297176.441674:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:1.0:1789297176.441923:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:1.0:1789297176.442045:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:1.0:1789297176.442095:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148928:0@lo:502: 00000100:00100000:1.0:1789297176.442302:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297176.442416:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297176.442464:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957148928 00000100:00100000:3.0:1789297176.442473:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957148928 00000100:00100000:3.0:1789297176.442564:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1789297176.442575:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148928:12345-0@lo:502: 00000100:00100000:3.0:1789297176.442880:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957148928:12345-0@lo:502: Request processed in 306us (577us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.442888:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1789297176.443301:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957148928:0@lo:502: 00000040:00080000:1.0:1789297176.443407:0:7627:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:1.0:1789297176.443419:0:7627:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1789297176.443986:0:7640:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1789297176.444003:0:7640:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff982b40b43370) 00000020:00000080:0.0:1789297176.444025:0:7640:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1789297176.444328:0:7640:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982a01db8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789297176.444334:0:7640:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a01db8800 from lustre-OST0001, refs=3 00000020:01000004:0.0:1789297176.444348:0:7640:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a01db8800 3 00010000:00080000:0.0:1789297176.444383:0:7640:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982b06765800@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.143@tcp at head 00010000:00010000:0.0:1789297176.447024:0:7640:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:0.0:1789297176.447484:0:7640:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:0.0:1789297176.447534:0:7640:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1789297176.447628:0:7640:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8ad177e823a0b339 00000100:00080000:0.0:1789297176.447642:0:7640:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789297176.447648:0:7640:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff982b06765800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789297176.447697:0:7640:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b41e15880 x1876213957149056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789297176.447750:0:7640:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1789297176.447909:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957149184:0@lo:400: 00000100:00100000:2.0:1789297176.448485:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957149056:0@lo:38: 00000100:00100000:3.0:1789297176.448668:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957149440:0@lo:400: 00000100:00100000:2.0:1789297176.448768:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297176.451034:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297176.451221:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297176.451235:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957149312:0@lo:400: 00000100:00100000:3.0:1789297176.451281:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.451775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297176.452086:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149440 00000100:00100000:1.0:1789297176.452096:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149440 00000100:00100000:1.0:1789297176.452292:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789297176.452304:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957149440:12345-0@lo:400: 00000100:00100000:1.0:1789297176.452390:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957149440:12345-0@lo:400: Request processed in 89us (1361us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.452398:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789297176.452441:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e17480 x1876213957149440/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297176.452457:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957149440:0@lo:400: 00000100:00100000:3.0:1789297176.452683:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149056 00000100:00100000:3.0:1789297176.452688:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149056 00000100:00100000:3.0:1789297176.452729:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149312 00000100:00100000:3.0:1789297176.452732:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149312 00000100:00100000:3.0:1789297176.452752:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149184 00000100:00100000:3.0:1789297176.452755:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149184 00000100:00100000:3.0:1789297176.452769:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789297176.452775:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957149312:12345-0@lo:400: 00000100:00100000:3.0:1789297176.452832:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957149312:12345-0@lo:400: Request processed in 47us (1540us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.452838:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789297176.452851:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789297176.452856:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957149184:12345-0@lo:400: 00000100:00100000:3.0:1789297176.452889:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957149184:12345-0@lo:400: Request processed in 33us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.452894:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789297176.452905:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297176.452909:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876213957149056:12345-0@lo:38: 00010000:00080000:3.0:1789297176.452963:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 188 last 0 00000020:00000080:3.0:1789297176.453008:0:5844:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8ad177e823a0b340 00000004:00100000:3.0:1789297176.453027:0:5844:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789297176.453073:0:5844:0:(import.c:65:import_set_state_nolock()) ffff982b406ed000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789297176.453318:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876213957149056:12345-0@lo:38: Request processed in 200us (4343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.453326:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:0.0:1789297176.453430:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789297176.453435:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789297176.453466:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e15180 x1876213957149184/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297176.453479:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957149184:0@lo:400: 00010000:00080000:1.0:1789297176.453639:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e14700 x1876213957149312/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297192 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297176.453648:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e14700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957149312:0@lo:400: 00000040:00080000:0.0:1789297176.453897:0:7640:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:3.0:1789297176.454248:0:7627:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:3.0:1789297176.454278:0:7627:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789297176.454303:0:7627:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.454314:0:7627:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789297176.454369:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789297176.454372:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789297176.454373:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297176.454374:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297176.454376:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297176.454377:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297176.454379:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789297176.454380:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789297176.454382:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789297176.454384:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297176.454385:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789297176.454389:0:7627:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:3.0:1789297176.454391:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789297176.454393:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789297176.454394:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297176.454395:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297176.454395:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297176.454397:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297176.454398:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789297176.454399:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789297176.454404:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789297176.454405:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297176.454406:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789297176.454429:0:7627:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1789297176.454446:0:7627:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957149568:0@lo:253: 00000100:00100000:3.0:1789297176.454503:0:7627:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297176.454535:0:7627:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11f50840 going to sleep for 11 seconds 00000100:00080000:1.0:1789297176.454696:0:7642:0:(client.c:1845:ptlrpc_send_new_req()) @@@ req waiting for recovery: (FULL != CONNECTING) req@ffff982b41ef5880 x1876213957149696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297176.454728:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7780 going to sleep for 0 seconds 00000100:00100000:0.0:1789297176.454787:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149568 00000100:00100000:0.0:1789297176.454793:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149568 00000100:00100000:0.0:1789297176.454841:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1789297176.454850:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7627:x1876213957149568:12345-0@lo:253: 20000000:01000000:0.0:1789297176.454871:0:5835:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:0.0:1789297176.454884:0:5835:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00080000:3.0:1789297176.456966:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41e15880 x1876213957149056/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789297186 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297176.456984:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789297176.456996:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:3.0:1789297176.457006:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789297176.457013:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789297176.457017:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b06765800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00080000:3.0:1789297176.457026:0:3301:0:(recover.c:191:ptlrpc_wake_delayed()) @@@ waking (set 00000000b9a7d550): req@ffff982b41ef5880 x1876213957149696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 0 ref 2 fl Rpc:WQU/200/ffffffff rc 0/-1 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297176.457051:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957149056:0@lo:38: 00000100:00100000:0.0:1789297176.457191:0:7642:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297176.457220:0:7642:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789297176.457327:0:5853:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149696 00000100:00100000:3.0:1789297176.457334:0:5853:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149696 00000100:00100000:3.0:1789297176.457405:0:5853:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297176.457413:0:5853:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1876213957149696:12345-0@lo:901: 00000100:00100000:3.0:1789297176.457824:0:5853:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7642:x1876213957149696:12345-0@lo:901: Request processed in 410us (632us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297176.457832:0:5853:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:0.0:1789297176.458032:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789297176.458060:0:7642:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b41ef5880 x1876213957149696/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1789297192 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297176.458073:0:7642:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7642:1876213957149696:0@lo:901: 20000000:01000000:0.0:1789297176.498788:0:5835:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1789297176.498801:0:5835:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1789297176.498878:0:5858:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789297176.498883:0:5858:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789297176.498906:0:5858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.498927:0:5858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.499011:0:5858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.499056:0:5858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.499615:0:5858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 14 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297176.499631:0:5858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876213957149824:0@lo:104: 00000100:00100000:2.0:1789297176.500488:0:5858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.500596:0:5858:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304300 going to sleep for 11 seconds 00000100:00100000:1.0:1789297176.502560:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149824 00000100:00100000:1.0:1789297176.502592:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149824 00000100:00100000:1.0:1789297176.502693:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297176.502721:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5858:x1876213957149824:12345-0@lo:104: 00010000:00010000:1.0:1789297176.502739:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297176.502842:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789297176.502859:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:5858:x1876213957149824:12345-0@lo:104: Request processed in 158us (2373us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297176.502866:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789297176.502933:0:5858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5858:1876213957149824:0@lo:104: 00010000:00010000:3.0:1789297176.502967:0:5858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.503427:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297176.503436:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.503452:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00030a00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297176.503456:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.503465:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297176.503472:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297176.503478:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:0.0:1789297176.503524:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.503530:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297176.503549:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.503556:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b00030a00/0x8ad177e823a0b291 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b298 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297176.503574:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297176.503577:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297176.503578:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297176.503591:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957149952:0@lo:103: 00000100:00100000:0.0:1789297176.503636:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297176.505560:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957149952 00000100:00100000:2.0:1789297176.505575:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957149952 00010000:00010000:2.0:1789297176.505612:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 15 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297176.505653:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789297176.505661:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:3304:x1876213957149952:12345-0@lo:103: 00010000:00010000:2.0:1789297176.505674:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297176.505679:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 15 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505689:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 15 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505737:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063000/0x8ad177e823a0b298 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b291 expref: 15 pid: 5837 timeout: 338 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505772:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505780:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789297176.505798:0:5828:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.006915283s 00010000:00010000:2.0:1789297176.505802:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505809:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505816:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505822:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505828:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297176.505833:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505841:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505855:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297176.505865:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297176.505955:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3304:x1876213957149952:12345-0@lo:103: Request processed in 295us (2319us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297176.505963:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1789297176.506055:0:5858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.506074:0:5858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297176.506081:0:5858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063a00/0x8ad177e823a0b347 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297176.506359:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957149952:0@lo:103: 00000100:00100000:0.0:1789297176.512608:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:7627:x1876213957149568:12345-0@lo:253: Request processed in 57749us (58094us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297176.512640:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1789297176.514232:0:7627:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7627:1876213957149568:0@lo:253: 10000000:01000000:3.0:1789297176.514252:0:7627:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1789297176.514255:0:7627:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789297176.514257:0:7627:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1789297176.514258:0:7627:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297176.514259:0:7627:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297176.514260:0:7627:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297176.514261:0:7627:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297176.514262:0:7627:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789297176.514264:0:7627:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1789297176.514265:0:7627:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1789297176.514267:0:7627:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297176.514268:0:7627:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789297176.514284:0:7627:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789297176.520575:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789297176.521130:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789297176.521377:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789297176.521547:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789297176.521758:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297176.523356:0:7627:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1789297176.524810:0:7627:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:0.0:1789297176.740746:0:7627:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:0.0:1789297176.740752:0:7627:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:0.0:1789297176.740783:0:7627:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1789297176.740836:0:7627:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1789297176.740848:0:7627:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:0.0:1789297176.740871:0:7627:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1789297177.021593:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297177.533878:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957150080:0@lo:13: 00000100:00100000:0.0:1789297177.533961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297177.534226:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150080 00000100:00100000:2.0:1789297177.534235:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150080 00000100:00100000:2.0:1789297177.534289:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297177.534298:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957150080:12345-0@lo:13: 00002000:00000024:2.0:1789297177.534360:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297177.534407:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957150080:12345-0@lo:13: Request processed in 110us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297177.534414:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1789297177.534528:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ee5f80 x1876213957150080/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297177.534546:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957150080:0@lo:13: 00010000:00010000:1.0:1789297178.045058:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297179.081410:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297180.094728:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297181.122145:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297181.628979:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957150336:0@lo:400: 00000100:00100000:0.0:1789297181.629052:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.629129:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:0.0:1789297181.629136:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957150208:0@lo:400: 00000100:00100000:0.0:1789297181.629398:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.629427:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957150720:0@lo:400: 00000100:00100000:0.0:1789297181.629453:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.629484:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957150464:0@lo:400: 00000100:00100000:0.0:1789297181.629509:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.629529:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297181.629535:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957150592:0@lo:400: 00000100:00100000:0.0:1789297181.629561:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.629744:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150336 00000100:00100000:0.0:1789297181.629755:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150336 00000100:00100000:0.0:1789297181.629801:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150720 00000100:00100000:0.0:1789297181.629805:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150720 00000100:00100000:1.0:1789297181.629970:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150464 00000100:00100000:1.0:1789297181.629975:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150464 00000100:00100000:1.0:1789297181.630002:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297181.630013:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957150336:12345-0@lo:400: 00000100:00100000:1.0:1789297181.630095:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957150336:12345-0@lo:400: Request processed in 83us (1043us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.630102:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297181.630123:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297181.630129:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957150720:12345-0@lo:400: 00000100:00100000:0.0:1789297181.630349:0:5844:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:0.0:1789297181.630358:0:5844:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:0.0:1789297181.630393:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150592 00000100:00100000:0.0:1789297181.630397:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150592 00000100:00100000:0.0:1789297181.630429:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789297181.630436:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957150592:12345-0@lo:400: 00000100:00100000:0.0:1789297181.630474:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957150592:12345-0@lo:400: Request processed in 38us (912us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.630481:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:0.0:1789297181.630498:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789297181.630503:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297181.630656:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957150720:12345-0@lo:400: Request processed in 31us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.630664:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297181.630688:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297181.630695:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957150464:12345-0@lo:400: 00000100:00100000:1.0:1789297181.630752:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957150464:12345-0@lo:400: Request processed in 57us (1241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.630757:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297181.630779:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150208 00000100:00100000:1.0:1789297181.630783:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150208 00000100:00100000:1.0:1789297181.630808:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789297181.630813:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:3303:x1876213957150208:12345-0@lo:400: 00000100:00100000:1.0:1789297181.630978:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:3303:x1876213957150208:12345-0@lo:400: Request processed in 164us (1580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.630984:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:1.0:1789297181.631050:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e15500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957150208:0@lo:400: 00010000:00080000:1.0:1789297181.632015:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e14380 x1876213957150720/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297181.632030:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957150720:0@lo:400: 00010000:00080000:1.0:1789297181.632058:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e16d80 x1876213957150336/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297181.632073:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957150336:0@lo:400: 00010000:00080000:1.0:1789297181.632132:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e17100 x1876213957150592/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297181.632142:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957150592:0@lo:400: 00010000:00080000:1.0:1789297181.632154:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e17800 x1876213957150464/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297197 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297181.633153:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957150464:0@lo:400: 10000000:01000000:3.0:1789297181.634154:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789297181.634272:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b121d2000 from 30 10000000:01000000:3.0:1789297181.634278:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789297181.634357:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.634381:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.634393:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297181.634418:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957150848:0@lo:101: 00000100:00100000:3.0:1789297181.634490:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297181.634527:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297181.634752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150848 00000100:00100000:0.0:1789297181.634761:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150848 00000100:00100000:0.0:1789297181.634806:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789297181.634816:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957150848:12345-0@lo:101: 00010000:00010000:0.0:1789297181.634829:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297181.634856:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b34e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.634883:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.634893:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.634902:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031e00, rc 0) 00000100:00100000:0.0:1789297181.634946:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957150848:12345-0@lo:101: Request processed in 132us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.634953:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789297181.636127:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957150848:0@lo:101: 00010000:00010000:3.0:1789297181.636148:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.637318:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297181.637417:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957150976:0@lo:501: 00000100:00100000:3.0:1789297181.637483:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297181.637519:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7600 going to sleep for 11 seconds 00000100:00100000:3.0:1789297181.640145:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957150976 00000100:00100000:3.0:1789297181.642301:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957150976 00000100:00100000:3.0:1789297181.642380:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1789297181.642391:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957150976:12345-0@lo:501: 00000100:00100000:3.0:1789297181.648102:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957150976:12345-0@lo:501: Request processed in 5705us (10612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297181.648117:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1789297181.648183:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957150976:0@lo:501: 00000100:00100000:2.0:1789297181.648251:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151104:0@lo:503: 00000100:00100000:2.0:1789297181.648310:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.648353:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7900 going to sleep for 11 seconds 00000100:00100000:0.0:1789297181.648760:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957151104 00000100:00100000:0.0:1789297181.648768:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957151104 00000100:00100000:0.0:1789297181.648815:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789297181.648841:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957151104:12345-0@lo:503: 00000100:00100000:0.0:1789297181.651393:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957151104:12345-0@lo:503: Request processed in 2552us (3072us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.651408:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:3.0:1789297181.651567:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151104:0@lo:503: 00000100:00100000:1.0:1789297181.673160:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7921:1876213957151232:0@lo:502: 00000100:00100000:1.0:1789297181.673268:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297181.673325:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b104a40c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297181.673482:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957151232 00000100:00100000:3.0:1789297181.673491:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957151232 00000100:00100000:3.0:1789297181.673543:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789297181.673553:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7921:x1876213957151232:12345-0@lo:502: 00000100:00100000:3.0:1789297181.674080:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7921:x1876213957151232:12345-0@lo:502: Request processed in 527us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297181.674088:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789297181.674266:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7921:1876213957151232:0@lo:502: 00000100:00100000:1.0:1789297181.674337:0:7921:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7921:1876213957151360:0@lo:502: 00000100:00100000:1.0:1789297181.674377:0:7921:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297181.674411:0:7921:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b104a40c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.674466:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957151360 00000100:00100000:2.0:1789297181.674471:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957151360 00000100:00100000:2.0:1789297181.674507:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1789297181.674515:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7921:x1876213957151360:12345-0@lo:502: 00000100:00100000:2.0:1789297181.674699:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:7921:x1876213957151360:12345-0@lo:502: Request processed in 185us (321us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.674723:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789297181.675164:0:7921:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7921:1876213957151360:0@lo:502: 00000040:00080000:1.0:1789297181.675189:0:7921:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789297181.675371:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789297181.675394:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789297181.675404:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.675416:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297181.675425:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789297181.675427:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:2.0:1789297181.675431:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789297181.675461:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.675470:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.675481:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.675494:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151488:0@lo:101: 00000100:00100000:2.0:1789297181.675536:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.675573:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789297181.676941:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957151488 00000100:00100000:3.0:1789297181.676954:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957151488 00000100:00100000:3.0:1789297181.677027:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789297181.677037:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957151488:12345-0@lo:101: 00010000:00010000:3.0:1789297181.677052:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297181.677066:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b35c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.677091:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.677100:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.677108:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a800, rc 0) 00000100:00100000:3.0:1789297181.677169:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957151488:12345-0@lo:101: Request processed in 133us (1631us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297181.677175:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1789297181.678368:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151488:0@lo:101: 00010000:00010000:2.0:1789297181.678392:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.678403:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.678505:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151616:0@lo:501: 00000100:00100000:2.0:1789297181.678551:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.678602:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.678622:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957151616 00000100:00100000:2.0:1789297181.678626:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957151616 00000100:00100000:2.0:1789297181.678660:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789297181.678669:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957151616:12345-0@lo:501: 00000100:00100000:2.0:1789297181.679106:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957151616:12345-0@lo:501: Request processed in 437us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.679114:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1789297181.679147:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151616:0@lo:501: 00000100:00100000:2.0:1789297181.679183:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151744:0@lo:503: 00000100:00100000:2.0:1789297181.679217:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.679229:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.679239:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957151744 00000100:00100000:2.0:1789297181.679242:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957151744 00000100:00100000:2.0:1789297181.679257:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789297181.679262:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957151744:12345-0@lo:503: 00000100:00100000:2.0:1789297181.679547:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957151744:12345-0@lo:503: Request processed in 283us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.679553:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:2.0:1789297181.679600:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957151744:0@lo:503: 00000100:00100000:2.0:1789297181.679836:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7922:1876213957151872:0@lo:502: 00000100:00100000:2.0:1789297181.679872:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297181.680008:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957151872 00000100:00100000:1.0:1789297181.680014:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957151872 00000100:00100000:1.0:1789297181.680037:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1789297181.680044:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7922:x1876213957151872:12345-0@lo:502: 00000100:00100000:2.0:1789297181.681457:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297181.683406:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7922:x1876213957151872:12345-0@lo:502: Request processed in 3351us (3522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.683420:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:2.0:1789297181.683556:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7922:1876213957151872:0@lo:502: 00000020:01000000:2.0:1789297181.683616:0:7922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297181.683628:0:7922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297181.683630:0:7922:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789297181.683637:0:7922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789297181.683640:0:7922:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1789297181.683681:0:7922:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7922:1876213957152000:0@lo:502: 00000100:00100000:2.0:1789297181.683773:0:7922:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.683820:0:7922:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297181.684109:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152000 00000100:00100000:1.0:1789297181.684117:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152000 00000100:00100000:1.0:1789297181.684163:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789297181.684173:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7922:x1876213957152000:12345-0@lo:502: 00000100:00100000:1.0:1789297181.684421:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:7922:x1876213957152000:12345-0@lo:502: Request processed in 249us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.684429:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:2.0:1789297181.684773:0:7922:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7922:1876213957152000:0@lo:502: 00000020:01000000:2.0:1789297181.684796:0:7922:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297181.684804:0:7922:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297181.684806:0:7922:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1789297181.684810:0:7922:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:3.0:1789297181.685090:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:3.0:1789297181.685113:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:3.0:1789297181.685129:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.685140:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297181.685152:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1789297181.685155:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b07359800 from 30 10000000:01000000:3.0:1789297181.685158:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789297181.685187:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.685196:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297181.685205:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297181.685221:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152128:0@lo:101: 00000100:00100000:3.0:1789297181.685256:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297181.685366:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297181.690419:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152128 00000100:00100000:1.0:1789297181.690437:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152128 00000100:00100000:1.0:1789297181.690508:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789297181.690519:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957152128:12345-0@lo:101: 00010000:00010000:1.0:1789297181.690536:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297181.690556:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b36a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297181.690593:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297181.690605:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 16 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297181.690614:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42176800, rc 0) 00000100:00100000:1.0:1789297181.690700:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957152128:12345-0@lo:101: Request processed in 182us (5442us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.690722:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789297181.692031:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f57800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152128:0@lo:101: 00010000:00010000:2.0:1789297181.692058:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.692072:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.692152:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152256:0@lo:501: 00000100:00100000:2.0:1789297181.692196:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.692238:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b76c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297181.692238:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152256 00000100:00100000:1.0:1789297181.692245:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152256 00000100:00100000:1.0:1789297181.692283:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789297181.692307:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957152256:12345-0@lo:501: 00000100:00100000:1.0:1789297181.692604:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957152256:12345-0@lo:501: Request processed in 298us (405us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.694415:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:3.0:1789297181.694498:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152256:0@lo:501: 00000100:00100000:3.0:1789297181.694555:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152384:0@lo:503: 00000100:00100000:3.0:1789297181.694628:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297181.694663:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152384 00000100:00100000:3.0:1789297181.694666:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4300 going to sleep for 11 seconds 00000100:00100000:1.0:1789297181.694670:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152384 00000100:00100000:1.0:1789297181.694734:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1789297181.694744:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957152384:12345-0@lo:503: 00000100:00100000:1.0:1789297181.695171:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957152384:12345-0@lo:503: Request processed in 428us (543us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297181.695179:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:3.0:1789297181.695361:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152384:0@lo:503: 00000100:00100000:3.0:1789297181.695647:0:7923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7923:1876213957152512:0@lo:502: 00000100:00100000:3.0:1789297181.695684:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.695736:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152512 00000100:00100000:3.0:1789297181.695737:0:7923:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e46c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.695742:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152512 00000100:00100000:2.0:1789297181.695788:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:2.0:1789297181.695796:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:7923:x1876213957152512:12345-0@lo:502: 00000100:00100000:2.0:1789297181.696374:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:7923:x1876213957152512:12345-0@lo:502: Request processed in 577us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.696383:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1789297181.698756:0:7923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7923:1876213957152512:0@lo:502: 00000100:00100000:0.0:1789297181.698852:0:7923:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7923:1876213957152640:0@lo:502: 00000100:00100000:0.0:1789297181.698993:0:7923:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.699042:0:7923:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3300 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.700144:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152640 00000100:00100000:2.0:1789297181.700156:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152640 00000100:00100000:2.0:1789297181.700208:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1789297181.700216:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:7923:x1876213957152640:12345-0@lo:502: 00000100:00100000:2.0:1789297181.700490:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:7923:x1876213957152640:12345-0@lo:502: Request processed in 273us (1496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.700498:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789297181.701015:0:7923:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7923:1876213957152640:0@lo:502: 00000040:00080000:0.0:1789297181.701051:0:7923:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:2.0:1789297181.703361:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:2.0:1789297181.703395:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789297181.703407:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.703420:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297181.703430:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1789297181.703433:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b07359800 from 5 10000000:01000000:2.0:1789297181.703436:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1789297181.703480:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.703489:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.703501:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.703537:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152768:0@lo:101: 00000100:00100000:2.0:1789297181.703605:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.703659:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297181.703662:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152768 00000100:00100000:0.0:1789297181.703670:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152768 00000100:00100000:0.0:1789297181.703744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789297181.703754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957152768:12345-0@lo:101: 00010000:00010000:0.0:1789297181.703767:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297181.703781:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00031600/0x8ad177e823a0b37f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b378 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.703805:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031600/0x8ad177e823a0b37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b378 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.703816:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00031600/0x8ad177e823a0b37f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b378 expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.703825:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031600, rc 0) 00000100:00100000:0.0:1789297181.703871:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957152768:12345-0@lo:101: Request processed in 118us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.703900:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1789297181.704048:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152768:0@lo:101: 00010000:00010000:2.0:1789297181.704063:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.704072:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.704121:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152896:0@lo:256: 00000100:00100000:2.0:1789297181.704153:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.704183:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297181.704227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957152896 00000100:00100000:0.0:1789297181.704232:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957152896 00000100:00100000:0.0:1789297181.704264:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789297181.704272:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957152896:12345-0@lo:256: 20000000:01000000:0.0:1789297181.704285:0:5837:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789297181.704317:0:5837:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789297181.704320:0:5837:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:0.0:1789297181.704401:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957152896:12345-0@lo:256: Request processed in 129us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.704409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1789297181.704470:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957152896:0@lo:256: 10000000:01000000:2.0:1789297181.704516:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789297181.704523:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.704532:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297181.704541:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1789297181.704543:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1789297181.704546:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789297181.704564:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.704593:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.704603:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.704614:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153024:0@lo:101: 00000100:00100000:2.0:1789297181.704640:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.704664:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.704677:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153024 00000100:00100000:2.0:1789297181.704680:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153024 00000100:00100000:2.0:1789297181.704740:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789297181.704772:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957153024:12345-0@lo:101: 00010000:00010000:2.0:1789297181.704780:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297181.704791:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b386 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.704806:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.704815:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.704823:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20062200, rc 0) 00000100:00100000:2.0:1789297181.704851:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957153024:12345-0@lo:101: Request processed in 105us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.704857:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1789297181.704880:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153024:0@lo:101: 00010000:00010000:2.0:1789297181.705078:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.705087:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.705132:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153152:0@lo:501: 00000100:00100000:2.0:1789297181.705157:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.705284:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.705314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153152 00000100:00100000:2.0:1789297181.705318:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153152 00000100:00100000:0.0:1789297181.705541:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1789297181.705551:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957153152:12345-0@lo:501: 00000100:00100000:0.0:1789297181.705853:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957153152:12345-0@lo:501: Request processed in 304us (695us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.705860:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789297181.705990:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153152:0@lo:501: 00000100:00100000:1.0:1789297181.706027:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153280:0@lo:503: 00000100:00100000:1.0:1789297181.706069:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297181.706102:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c73cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297181.706142:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153280 00000100:00100000:0.0:1789297181.706147:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153280 00000100:00100000:0.0:1789297181.706176:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789297181.706183:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957153280:12345-0@lo:503: 00000100:00100000:0.0:1789297181.706484:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957153280:12345-0@lo:503: Request processed in 301us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.706491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789297181.706597:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153280:0@lo:503: 00000100:00100000:1.0:1789297181.706973:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7924:1876213957153408:0@lo:502: 00000100:00100000:1.0:1789297181.707011:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297181.707042:0:7924:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1da80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297181.707146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153408 00000100:00100000:0.0:1789297181.707151:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153408 00000100:00100000:0.0:1789297181.707185:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789297181.707193:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:7924:x1876213957153408:12345-0@lo:502: 00000100:00100000:0.0:1789297181.707441:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:7924:x1876213957153408:12345-0@lo:502: Request processed in 248us (429us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.707448:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789297181.707535:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7924:1876213957153408:0@lo:502: 00000020:01000000:1.0:1789297181.707559:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789297181.707567:0:7924:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789297181.707574:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297181.707576:0:7924:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789297181.707581:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789297181.707585:0:7924:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:1.0:1789297181.707607:0:7924:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789297181.707610:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789297181.707626:0:7924:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff982b40cacd28) 00000020:00000080:1.0:1789297181.707650:0:7924:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:1.0:1789297181.707656:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789297181.707761:0:7924:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789297181.707767:0:7924:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789297181.707774:0:7924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0b39b 00010000:00080000:1.0:1789297181.707813:0:7924:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982b1209c000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789297181.708056:0:7924:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:1.0:1789297181.708368:0:7924:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:1.0:1789297181.708381:0:7924:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789297181.708902:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789297181.709096:0:7924:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789297181.709146:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:1.0:1789297181.709201:0:7924:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000020:00000080:0.0:1789297181.713669:0:7924:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789297181.713683:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1789297181.713772:0:7924:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:0.0:1789297181.713794:0:7924:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0b3a2 00000100:00080000:0.0:1789297181.713805:0:7924:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789297181.713811:0:7924:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982b1209c000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789297181.713848:0:7924:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b41e17480 x1876213957153536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789297181.713871:0:7924:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00100000:3.0:1789297181.713991:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957153536:0@lo:8: 00000100:00100000:3.0:1789297181.714066:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297181.714128:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153536 00000100:00100000:3.0:1789297181.714136:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153536 00000100:00100000:3.0:1789297181.714165:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789297181.714172:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876213957153536:12345-0@lo:8: 00010000:00080000:3.0:1789297181.714196:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 193 last 0 00000020:00000080:3.0:1789297181.714217:0:6687:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0b3a9 00002000:00100000:3.0:1789297181.714230:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff982b406ec000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:3.0:1789297181.714234:0:6687:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:3.0:1789297181.714237:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:3.0:1789297181.714369:0:6687:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789297181.714532:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789297181.714555:0:6687:0:(import.c:65:import_set_state_nolock()) ffff982b406ef000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789297181.714605:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876213957153536:12345-0@lo:8: Request processed in 431us (538us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297181.714613:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:3.0:1789297181.714651:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e17480 x1876213957153536/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789297191 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297181.714662:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789297181.714669:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1789297181.714676:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789297181.714680:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1789297181.714683:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b1209c000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789297181.714689:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789297181.714694:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957153536:0@lo:8: 00000020:01000000:0.0:1789297181.714991:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297181.714997:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297181.714999:0:7924:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:0.0:1789297181.715002:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297181.715006:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297181.715007:0:7924:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1789297181.715009:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1789297181.715011:0:7924:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1789297181.715038:0:7924:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7924:1876213957153664:0@lo:502: 00000100:00100000:0.0:1789297181.715084:0:7924:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.715111:0:7924:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3900 going to sleep for 11 seconds 00000040:00080000:2.0:1789297181.715205:0:7925:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297181.715210:0:7925:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000004:00080000:2.0:1789297181.715242:0:7925:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789297181.715336:0:7925:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 193589631136ns, next at 0ns, rc = 0 00000100:00100000:0.0:1789297181.716777:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153664 00000100:00100000:0.0:1789297181.716792:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153664 00000100:00100000:0.0:1789297181.716847:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789297181.716858:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:7924:x1876213957153664:12345-0@lo:502: 00000100:00100000:0.0:1789297181.717189:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:7924:x1876213957153664:12345-0@lo:502: Request processed in 332us (2103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.717204:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:3.0:1789297181.717325:0:7924:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:7924:1876213957153664:0@lo:502: 00000020:01000000:3.0:1789297181.717359:0:7924:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789297181.717366:0:7924:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297181.717368:0:7924:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:3.0:1789297181.717372:0:7924:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:0.0:1789297181.717518:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:0.0:1789297181.717540:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789297181.717552:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.717564:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297181.717576:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:0.0:1789297181.717650:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982b18368000 from 1 10000000:01000000:0.0:1789297181.717654:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789297181.717686:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.717696:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297181.717740:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297181.717760:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153792:0@lo:101: 00000100:00100000:0.0:1789297181.717800:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297181.717837:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe30c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.717973:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153792 00000100:00100000:2.0:1789297181.717978:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153792 00000100:00100000:2.0:1789297181.718014:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789297181.718021:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957153792:12345-0@lo:101: 00010000:00010000:2.0:1789297181.718029:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297181.718042:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b3b0 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.718065:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.718076:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.718096:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20063800, rc 0) 00000100:00100000:2.0:1789297181.718130:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957153792:12345-0@lo:101: Request processed in 109us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.718136:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1789297181.718457:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153792:0@lo:101: 00010000:00010000:2.0:1789297181.718471:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.718479:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297181.718531:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153920:0@lo:501: 00000100:00100000:2.0:1789297181.718561:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.718575:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b76c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297181.718690:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957153920 00000100:00100000:3.0:1789297181.718695:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957153920 00000100:00100000:3.0:1789297181.718739:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:3.0:1789297181.718747:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957153920:12345-0@lo:501: 00000100:00100000:3.0:1789297181.719122:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957153920:12345-0@lo:501: Request processed in 375us (559us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789297181.719130:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1789297181.719241:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957153920:0@lo:501: 10000000:01000000:2.0:1789297181.719269:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789297181.719274:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297181.719281:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789297181.799044:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000004:00080000:3.0:1789297181.843106:0:7926:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:3.0:1789297181.843142:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154176:0@lo:7: 00000100:00100000:2.0:1789297181.843143:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957154048:0@lo:13: 00000100:00100000:3.0:1789297181.848319:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297181.848390:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4240 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.849283:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297181.849789:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154048 00000100:00100000:2.0:1789297181.849793:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154176 00000100:00100000:3.0:1789297181.849799:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154048 00000100:00100000:2.0:1789297181.849800:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154176 00000100:00080000:0.0:1789297181.849889:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789297181.849998:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789297181.850096:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297181.850105:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957154048:12345-0@lo:13: 00002000:00000024:3.0:1789297181.850149:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:3.0:1789297181.850205:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957154048:12345-0@lo:13: Request processed in 102us (922us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297181.850212:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789297181.850257:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f55500 x1876213957154048/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297197 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297181.850278:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957154048:0@lo:13: 00000100:00100000:2.0:1789297181.860662:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7926:x1876213957154176:12345-0@lo:7: 00002000:00080000:2.0:1789297181.883314:0:6689:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:2.0:1789297181.883323:0:6689:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789297181.883425:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:7926:x1876213957154176:12345-0@lo:7: Request processed in 33412us (35109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297181.883435:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:2.0:1789297181.883489:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f57100 x1876213957154176/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1789297197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297181.883503:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f57100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154176:0@lo:7: 00000004:00080000:2.0:1789297181.883517:0:7926:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:2.0:1789297181.883554:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154304:0@lo:5: 00000100:00100000:2.0:1789297181.883598:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.883645:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7180 going to sleep for 11 seconds 00000100:00100000:2.0:1789297181.883665:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154304 00000100:00100000:2.0:1789297181.883672:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154304 00000100:00100000:2.0:1789297181.883753:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789297181.883763:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7926:x1876213957154304:12345-0@lo:5: 00002000:00080000:2.0:1789297181.883787:0:6688:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:2.0:1789297181.883791:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:2.0:1789297181.884000:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bf100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:7926:x1876213957154304:12345-0@lo:5: Request processed in 238us (401us total) trans 4294967297 rc 0/0 00000100:00100000:2.0:1789297181.884007:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:2.0:1789297181.884042:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ee4000 x1876213957154304/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789297197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297181.884054:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154304:0@lo:5: 00000004:00080000:2.0:1789297181.886644:0:7926:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:2.0:1789297181.886690:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154432:0@lo:700: 00000100:00100000:2.0:1789297181.886768:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297181.886798:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7180 going to sleep for 11 seconds 00000100:00100000:1.0:1789297181.886911:0:6695:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154432 00000100:00100000:1.0:1789297181.886919:0:6695:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154432 00000100:00100000:1.0:1789297181.886967:0:6695:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1789297181.886976:0:6695:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:7926:x1876213957154432:12345-0@lo:700: 00000100:00100000:1.0:1789297181.887011:0:6695:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1876213957154560:0@lo:700: 00000100:00100000:1.0:1789297181.887041:0:6695:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297181.887074:0:6695:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec180 going to sleep for 11 seconds 00000100:00100000:0.0:1789297181.887807:0:5849:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154560 00000100:00100000:0.0:1789297181.887813:0:5849:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154560 00000100:00100000:0.0:1789297181.887853:0:5849:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297181.887861:0:5849:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1876213957154560:12345-0@lo:700: 40000000:02000000:0.0:1789297181.937942:0:5849:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1789297181.946522:0:5849:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6695:x1876213957154560:12345-0@lo:700: Request processed in 58649us (59467us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297181.946542:0:5849:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789297181.947021:0:6695:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef7480 x1876213957154560/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1789297197 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297181.947040:0:6695:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6695:1876213957154560:0@lo:700: 40000000:02000000:1.0:1789297181.947055:0:6695:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00080000:3.0:1789297182.056521:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000001:00100000:3.0:1789297182.056544:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:2.0:1789297182.058219:0:6695:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:7926:x1876213957154432:12345-0@lo:700: Request processed in 171234us (171440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297182.058234:0:6695:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1789297182.058748:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bdc00 x1876213957154432/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1789297197 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297182.058762:0:7926:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1789297182.058795:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bdc00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154432:0@lo:700: 00010000:00010000:2.0:1789297182.142751:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:02000040:0.0:1789297182.169431:0:7926:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:0.0:1789297182.175778:0:7926:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154688:0@lo:5: 00000100:00100000:0.0:1789297182.175874:0:7926:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297182.175937:0:7926:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789297182.175983:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154688 00000100:00100000:2.0:1789297182.175993:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154688 00000100:00100000:2.0:1789297182.176053:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789297182.176064:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:7926:x1876213957154688:12345-0@lo:5: 00002000:00080000:2.0:1789297182.187371:0:6688:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:2.0:1789297182.187399:0:6688:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1789297182.202647:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:7926:x1876213957154688:12345-0@lo:5: Request processed in 26577us (26765us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1789297182.202662:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1789297182.205151:0:7926:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e17100 x1876213957154688/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1789297198 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297182.205175:0:7926:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:7926:1876213957154688:0@lo:5: 00000004:00080000:1.0:1789297182.205195:0:7926:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00000100:00100000:2.0:1789297182.653268:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789297182.653311:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957154816:0@lo:13: 00000100:00100000:2.0:1789297182.653391:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297182.653437:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154816 00000100:00100000:3.0:1789297182.653447:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154816 00000100:00100000:3.0:1789297182.654083:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789297182.654099:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957154816:12345-0@lo:13: 00002000:00000024:3.0:1789297182.654141:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297182.654207:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957154816:12345-0@lo:13: Request processed in 113us (814us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297182.654216:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789297182.661821:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bdf80 x1876213957154816/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297182.661852:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957154816:0@lo:13: 00000001:02000400:0.0:1789297182.898190:0:7993:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789297183.165787:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297184.190947:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297185.212924:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297186.239799:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297186.760220:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957155072:0@lo:400: 00000100:00100000:3.0:1789297186.760303:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297186.760359:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957155584:0@lo:400: 00000100:00100000:3.0:1789297186.760384:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297186.760412:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789297186.760418:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957155200:0@lo:400: 00000100:00100000:3.0:1789297186.760437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297186.760470:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155072 00000100:00100000:3.0:1789297186.760477:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155072 00000100:00100000:3.0:1789297186.760516:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155200 00000100:00100000:3.0:1789297186.760519:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155200 00000100:00100000:3.0:1789297186.760547:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297186.760556:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957155072:12345-0@lo:400: 00000100:00100000:3.0:1789297186.760606:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957155072:12345-0@lo:400: Request processed in 51us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297186.760613:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297186.760639:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789297186.760644:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957155200:12345-0@lo:400: 00000100:00100000:3.0:1789297186.760672:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957155200:12345-0@lo:400: Request processed in 29us (235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297186.760678:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789297186.760695:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155584 00000100:00100000:3.0:1789297186.760698:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155584 00000100:00100000:3.0:1789297186.760746:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297186.760753:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957155584:12345-0@lo:400: 00000100:00100000:3.0:1789297186.760781:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957155584:12345-0@lo:400: Request processed in 29us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297186.760787:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00080000:3.0:1789297186.760806:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297186.760811:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789297186.760835:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f54a80 x1876213957155200/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297186.760849:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957155200:0@lo:400: 00010000:00080000:3.0:1789297186.760860:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f54000 x1876213957155072/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297186.760868:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957155072:0@lo:400: 00010000:00080000:3.0:1789297186.760876:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f54e00 x1876213957155584/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297186.760884:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957155584:0@lo:400: 00000100:00100000:2.0:1789297186.760934:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957154944:0@lo:400: 00000100:00100000:1.0:1789297186.761057:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957155328:0@lo:400: 00000100:00100000:1.0:1789297186.761085:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297186.761168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297186.761193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957155456:0@lo:400: 00000100:00100000:2.0:1789297186.761215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297186.761251:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957154944 00000100:00100000:2.0:1789297186.761255:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957154944 00000100:00100000:2.0:1789297186.761280:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:2.0:1789297186.761286:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957154944:12345-0@lo:400: 00000100:00100000:3.0:1789297186.761302:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155456 00000100:00100000:3.0:1789297186.761305:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155456 00000100:00100000:2.0:1789297186.761322:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957154944:12345-0@lo:400: Request processed in 37us (154us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297186.761328:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789297186.761329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789297186.761340:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957155456:12345-0@lo:400: 00000100:00100000:2.0:1789297186.761358:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957154944:0@lo:400: 00000100:00100000:3.0:1789297186.761369:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957155456:12345-0@lo:400: Request processed in 29us (152us total) trans 0 rc 0/0 00010000:00080000:2.0:1789297186.761369:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f57100 x1876213957155456/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297186.761375:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1789297186.761378:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957155456:0@lo:400: 00000100:00080000:3.0:1789297186.761390:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297186.761696:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155328 00000100:00100000:1.0:1789297186.761729:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155328 00000100:00080000:2.0:1789297186.761752:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789297186.761777:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297186.761784:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957155328:12345-0@lo:400: 00000100:00100000:2.0:1789297186.761827:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957155328:12345-0@lo:400: Request processed in 44us (741us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297186.761834:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1789297186.761856:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f57480 x1876213957155328/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297202 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297186.761866:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f57480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957155328:0@lo:400: 00010000:00010000:1.0:1789297187.262139:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297187.264026:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957155712:0@lo:13: 00000100:00100000:3.0:1789297187.265722:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297187.265830:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155712 00000100:00100000:3.0:1789297187.265840:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155712 00000100:00100000:3.0:1789297187.265888:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789297187.265898:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876213957155712:12345-0@lo:13: 00002000:00000024:3.0:1789297187.265935:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297187.266002:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3303:x1876213957155712:12345-0@lo:13: Request processed in 105us (287us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297187.266010:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:3.0:1789297187.267775:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e14380 x1876213957155712/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297187.267809:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e14380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957155712:0@lo:13: 00000001:00080000:3.0:1789297187.353689:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:2.0:1789297187.775196:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789297187.775223:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957155840:0@lo:13: 00000100:00100000:2.0:1789297187.775316:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297187.775438:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155840 00000100:00100000:3.0:1789297187.775507:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155840 00000100:00100000:3.0:1789297187.775566:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789297187.775577:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957155840:12345-0@lo:13: 00002000:00000024:3.0:1789297187.775617:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297187.775845:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957155840:12345-0@lo:13: Request processed in 269us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297187.775853:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:3.0:1789297187.775900:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bc380 x1876213957155840/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297187.775920:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957155840:0@lo:13: 00010000:00010000:1.0:1789297188.288660:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297188.344947:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297188.345483:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933015168 00000100:00100000:0.0:1789297188.345497:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933015168 00000100:00100000:0.0:1789297188.345551:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 112 00000100:00100000:0.0:1789297188.345561:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1876213933015168:12345-192.168.202.43@tcp:250: 00010000:00080000:0.0:1789297188.345593:0:5837:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f59e9b32-8d04-4473-8f89-1f536fa8f452@192.168.202.43@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:0.0:1789297188.345625:0:5837:0:(genops.c:1385:class_connect()) connect: client f59e9b32-8d04-4473-8f89-1f536fa8f452, cookie 0x8ad177e823a0b3be 00000100:00080000:0.0:1789297188.345787:0:5837:0:(import.c:65:import_set_state_nolock()) ffff982a0170f000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789297188.345869:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+5:2352:x1876213933015168:12345-192.168.202.43@tcp:250: Request processed in 307us (933us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.345889:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 112 00000100:00100000:0.0:1789297188.352996:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297188.353222:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933015296 00000100:00100000:3.0:1789297188.353242:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933015296 00000100:00100000:3.0:1789297188.353305:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 113 00000100:00100000:3.0:1789297188.353317:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+5:5583:x1876213933015296:12345-192.168.202.43@tcp:101: 00010000:00010000:3.0:1789297188.353337:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297188.353356:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d7d3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297188.353389:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297188.353402:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297188.353413:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b600, rc 0) 00000100:00100000:3.0:1789297188.353473:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+6:5583:x1876213933015296:12345-192.168.202.43@tcp:101: Request processed in 159us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297188.353481:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 113 00000100:00100000:3.0:1789297188.357850:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297188.358268:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933015424 00000100:00100000:1.0:1789297188.358279:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933015424 00000100:00100000:1.0:1789297188.358340:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:1.0:1789297188.358349:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+6:5583:x1876213933015424:12345-192.168.202.43@tcp:501: 00000100:00100000:1.0:1789297188.358758:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+6:5583:x1876213933015424:12345-192.168.202.43@tcp:501: Request processed in 407us (915us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789297188.358768:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:1.0:1789297188.363958:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297188.364259:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933015552 00000100:00100000:3.0:1789297188.364270:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933015552 00000100:00100000:3.0:1789297188.364330:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:3.0:1789297188.364340:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+6:5583:x1876213933015552:12345-192.168.202.43@tcp:101: 00010000:00010000:3.0:1789297188.364359:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297188.364390:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d7da expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297188.364420:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297188.364432:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297188.364443:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152be00, rc 0) 00000100:00100000:3.0:1789297188.364501:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+7:5583:x1876213933015552:12345-192.168.202.43@tcp:101: Request processed in 162us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297188.364508:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:0.0:1789297188.367217:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297188.367291:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933015680 00000100:00100000:3.0:1789297188.367301:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933015680 00000100:00100000:3.0:1789297188.367394:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:3.0:1789297188.367406:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+7:5583:x1876213933015680:12345-192.168.202.43@tcp:501: 00000100:00100000:3.0:1789297188.367696:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5583:x1876213933015680:12345-192.168.202.43@tcp:501: Request processed in 291us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297188.367728:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:2.0:1789297188.373479:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297188.373547:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933015808 00000100:00100000:0.0:1789297188.373556:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933015808 00000100:00100000:0.0:1789297188.373609:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:0.0:1789297188.373618:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5583:x1876213933015808:12345-192.168.202.43@tcp:503: 00000100:00100000:0.0:1789297188.374355:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5583:x1876213933015808:12345-192.168.202.43@tcp:503: Request processed in 734us (881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.374364:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:2.0:1789297188.376440:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297188.376600:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933015936 00000100:00100000:0.0:1789297188.376610:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933015936 00000100:00100000:0.0:1789297188.376662:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:0.0:1789297188.376672:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5601:x1876213933015936:12345-192.168.202.43@tcp:502: 00000100:00100000:0.0:1789297188.377181:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5601:x1876213933015936:12345-192.168.202.43@tcp:502: Request processed in 509us (747us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.377191:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:3.0:1789297188.404574:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297188.404692:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016064 00000100:00100000:0.0:1789297188.404716:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016064 00000100:00100000:0.0:1789297188.404772:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:0.0:1789297188.404785:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5601:x1876213933016064:12345-192.168.202.43@tcp:502: 00000100:00100000:0.0:1789297188.405076:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5601:x1876213933016064:12345-192.168.202.43@tcp:502: Request processed in 294us (514us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.405084:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:2.0:1789297188.409279:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297188.409332:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016192 00000100:00100000:0.0:1789297188.409354:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016192 00000100:00100000:0.0:1789297188.409419:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:0.0:1789297188.409429:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5583:x1876213933016192:12345-192.168.202.43@tcp:101: 00010000:00010000:0.0:1789297188.409659:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297188.409680:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b3d3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d804 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297188.409734:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b3d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d804 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297188.409748:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b3d3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d804 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297188.409758:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031a00, rc 0) 00000100:00100000:0.0:1789297188.409833:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5583:x1876213933016192:12345-192.168.202.43@tcp:101: Request processed in 405us (568us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.409839:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:0.0:1789297188.416495:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297188.416735:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016320 00000100:00100000:3.0:1789297188.416746:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016320 00000100:00100000:3.0:1789297188.416818:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:3.0:1789297188.417090:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5583:x1876213933016320:12345-192.168.202.43@tcp:256: 20000000:01000000:3.0:1789297188.417122:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1789297188.417148:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1789297188.417152:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1789297188.417160:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1789297188.417163:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:0.0:1789297188.418819:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5583:x1876213933016320:12345-192.168.202.43@tcp:256: Request processed in 1970us (2316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.418838:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:2.0:1789297188.422151:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297188.423208:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016448 00000100:00100000:0.0:1789297188.423241:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016448 00000100:00100000:0.0:1789297188.423292:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:0.0:1789297188.423301:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5583:x1876213933016448:12345-192.168.202.43@tcp:101: 00010000:00010000:0.0:1789297188.423319:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297188.423339:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d80b expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297188.423382:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297188.423395:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 10 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297188.423405:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00030a00, rc 0) 00000100:00100000:0.0:1789297188.423465:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5583:x1876213933016448:12345-192.168.202.43@tcp:101: Request processed in 165us (1327us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.423473:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:0.0:1789297188.426182:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297188.426275:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016576 00000100:00100000:3.0:1789297188.426287:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016576 00000100:00100000:3.0:1789297188.426346:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:3.0:1789297188.426358:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5583:x1876213933016576:12345-192.168.202.43@tcp:501: 00000100:00100000:3.0:1789297188.426625:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5583:x1876213933016576:12345-192.168.202.43@tcp:501: Request processed in 268us (453us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297188.426633:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:0.0:1789297188.428613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297188.428691:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016704 00000100:00100000:3.0:1789297188.428717:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016704 00000100:00100000:3.0:1789297188.428766:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:3.0:1789297188.428776:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5583:x1876213933016704:12345-192.168.202.43@tcp:503: 00000100:00100000:3.0:1789297188.429357:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5583:x1876213933016704:12345-192.168.202.43@tcp:503: Request processed in 580us (752us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297188.429366:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:3.0:1789297188.431991:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297188.432161:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016832 00000100:00100000:1.0:1789297188.432172:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016832 00000100:00100000:1.0:1789297188.432242:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:1.0:1789297188.432253:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5605:x1876213933016832:12345-192.168.202.43@tcp:502: 00000100:00100000:1.0:1789297188.432530:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5605:x1876213933016832:12345-192.168.202.43@tcp:502: Request processed in 279us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297188.432539:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:0.0:1789297188.438436:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297188.438474:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933016960 00000100:00100000:0.0:1789297188.438485:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933016960 00000100:00100000:0.0:1789297188.438537:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:0.0:1789297188.438547:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5605:x1876213933016960:12345-192.168.202.43@tcp:502: 00000100:00100000:0.0:1789297188.438791:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5605:x1876213933016960:12345-192.168.202.43@tcp:502: Request processed in 245us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297188.438799:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:3.0:1789297188.444769:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297188.445033:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017088 00000100:00100000:2.0:1789297188.445043:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017088 00000100:00100000:2.0:1789297188.445086:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789297188.445094:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1876213933017088:12345-192.168.202.43@tcp:38: 00010000:00080000:2.0:1789297188.445127:0:5844:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp t0 exp 0000000000000000 cur 200 last 0 00000020:00000080:2.0:1789297188.445185:0:5844:0:(genops.c:1385:class_connect()) connect: client 235dd3df-f928-4719-bb69-fc817cc2744f, cookie 0x8ad177e823a0b3e1 00000004:00100000:2.0:1789297188.445215:0:5844:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1789297188.445221:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1789297188.480988:0:5844:0:(import.c:65:import_set_state_nolock()) ffff982b39cb9000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297188.481057:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2352:x1876213933017088:12345-192.168.202.43@tcp:38: Request processed in 35962us (36297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297188.481065:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00010000:00010000:3.0:1789297189.309046:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297189.483894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297189.483969:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297189.484120:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017344 00000100:00100000:3.0:1789297189.484132:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017344 00000100:00080000:2.0:1789297189.484205:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297189.484226:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017216 00000100:00100000:3.0:1789297189.484230:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017216 00000100:00100000:3.0:1789297189.484259:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:3.0:1789297189.484268:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:5583:x1876213933017344:12345-192.168.202.43@tcp:41: 00000004:00000024:3.0:1789297189.484309:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:3.0:1789297189.484373:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:5583:x1876213933017344:12345-192.168.202.43@tcp:41: Request processed in 105us (487us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297189.484387:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789297189.484399:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:2.0:1789297189.484404:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:0:x1876213933017216:12345-192.168.202.43@tcp:41: 00000004:00000024:2.0:1789297189.484421:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1789297189.484467:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:0:x1876213933017216:12345-192.168.202.43@tcp:41: Request processed in 67us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297189.484474:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:2.0:1789297189.486671:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297189.486761:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017472 00000100:00100000:3.0:1789297189.486771:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017472 00000100:00100000:3.0:1789297189.486823:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789297189.486842:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:5583:x1876213933017472:12345-192.168.202.43@tcp:40: 00000100:00100000:3.0:1789297189.487059:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024be300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:5583:x1876213933017472:12345-192.168.202.43@tcp:40: Request processed in 226us (398us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297189.487066:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789297189.488867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297189.489266:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017856 00000100:00100000:0.0:1789297189.489276:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017856 00000100:00100000:0.0:1789297189.489326:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297189.489335:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:5583:x1876213933017856:12345-192.168.202.43@tcp:33: 00000100:00100000:2.0:1789297189.490230:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297189.490289:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017984 00000100:00100000:1.0:1789297189.490301:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017984 00000100:00100000:1.0:1789297189.490341:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 127 00000100:00100000:2.0:1789297189.490347:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297189.490354:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2354:x1876213933017984:12345-192.168.202.43@tcp:400: 00000100:00100000:2.0:1789297189.490389:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297189.490414:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017600 00000100:00100000:1.0:1789297189.490419:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2354:x1876213933017984:12345-192.168.202.43@tcp:400: Request processed in 69us (200us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297189.490420:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017600 00000100:00100000:1.0:1789297189.490429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 127 00000100:00100000:2.0:1789297189.490520:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933017728 00000100:00100000:2.0:1789297189.490524:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933017728 00000100:00100000:1.0:1789297189.490552:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789297189.490558:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876213933017600:12345-192.168.202.43@tcp:8: 00010000:00080000:1.0:1789297189.490582:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1789297189.490612:0:6689:0:(genops.c:1385:class_connect()) connect: client 235dd3df-f928-4719-bb69-fc817cc2744f, cookie 0x8ad177e823a0b3e8 00002000:00100000:1.0:1789297189.490625:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 235dd3df-f928-4719-bb69-fc817cc2744f/ffff982b27c32800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789297189.490652:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789297189.491028:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789297189.491054:0:6689:0:(import.c:65:import_set_state_nolock()) ffff982b27c31800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789297189.491102:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2352:x1876213933017600:12345-192.168.202.43@tcp:8: Request processed in 543us (757us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297189.496386:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789297189.496422:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789297189.496431:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876213933017728:12345-192.168.202.43@tcp:8: 00010000:00080000:1.0:1789297189.496468:0:6689:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp t0 exp 0000000000000000 cur 201 last 0 00000020:00000080:1.0:1789297189.496505:0:6689:0:(genops.c:1385:class_connect()) connect: client 235dd3df-f928-4719-bb69-fc817cc2744f, cookie 0x8ad177e823a0b3ef 00002000:00100000:1.0:1789297189.496522:0:6689:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 235dd3df-f928-4719-bb69-fc817cc2744f/ffff982b27c32000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789297189.496546:0:6689:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789297189.496909:0:6689:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789297189.496962:0:6689:0:(import.c:65:import_set_state_nolock()) ffff982b27c35000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789297189.497044:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2352:x1876213933017728:12345-192.168.202.43@tcp:8: Request processed in 613us (6654us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297189.497051:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000004:00080000:0.0:1789297189.514755:0:5845:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 25344us 00000004:00200000:0.0:1789297189.528451:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:0.0:1789297189.528571:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:5583:x1876213933017856:12345-192.168.202.43@tcp:33: Request processed in 39232us (39705us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297189.528583:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:3.0:1789297189.702810:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297189.703006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933018112 00000100:00100000:0.0:1789297189.703016:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933018112 00000100:00100000:0.0:1789297189.703076:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789297189.703087:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:5622:x1876213933018112:12345-192.168.202.43@tcp:101: 00010000:00010000:0.0:1789297189.703109:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297189.703134:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031000/0x8ad177e823a0b3f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d835 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297189.703230:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b3fd lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297189.703245:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297189.703260:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297189.703670:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789297189.703675:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297189.703691:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b3fd lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297189.703754:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031000/0x8ad177e823a0b3f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d835 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297189.703791:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b3fd lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d835 expref: 7 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297189.703801:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b15d3ae00) 00010000:00010000:0.0:1789297189.703804:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789297189.703807:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb000, rc 0) 00000100:00100000:0.0:1789297189.704515:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:5622:x1876213933018112:12345-192.168.202.43@tcp:101: Request processed in 1426us (1710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297189.704523:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00010000:00010000:1.0:1789297190.333422:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297191.357330:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297191.870468:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957156352:0@lo:400: 00000100:00100000:1.0:1789297191.870546:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297191.870613:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789297191.870619:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957155968:0@lo:400: 00000100:00100000:1.0:1789297191.870646:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297191.870667:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957156480:0@lo:400: 00000100:00100000:1.0:1789297191.870689:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297191.870735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957155968 00000100:00100000:1.0:1789297191.870742:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957155968 00000100:00100000:1.0:1789297191.870787:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1789297191.870963:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156352 00000100:00100000:0.0:1789297191.870967:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156352 00000100:00100000:0.0:1789297191.871005:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789297191.871012:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957156352:12345-0@lo:400: 00000100:00100000:0.0:1789297191.871066:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957156352:12345-0@lo:400: Request processed in 54us (520us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297191.871072:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:0.0:1789297191.871125:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b385a1500 x1876213957156352/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297191.871140:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957156352:0@lo:400: 00000100:00100000:1.0:1789297191.871371:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957155968:12345-0@lo:400: 00000100:00080000:2.0:1789297191.871755:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297191.871940:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957155968:12345-0@lo:400: Request processed in 575us (1291us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297191.871947:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789297191.872031:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957156096:0@lo:400: 00000100:00100000:3.0:1789297191.872062:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297191.872088:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957156608:0@lo:400: 00000100:00100000:3.0:1789297191.872106:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297191.872127:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789297191.872133:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957156224:0@lo:400: 00000100:00100000:3.0:1789297191.872164:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297191.872214:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156480 00000100:00100000:3.0:1789297191.872218:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156480 00000100:00100000:3.0:1789297191.872356:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156096 00000100:00100000:3.0:1789297191.872359:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156096 00000100:00100000:3.0:1789297191.872371:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156224 00000100:00100000:3.0:1789297191.872373:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156224 00000100:00100000:3.0:1789297191.872387:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789297191.872393:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957156480:12345-0@lo:400: 00000100:00100000:3.0:1789297191.872824:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957156480:12345-0@lo:400: Request processed in 429us (2132us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297191.872837:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789297191.872851:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789297191.872857:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957156096:12345-0@lo:400: 00000100:00100000:3.0:1789297191.872887:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957156096:12345-0@lo:400: Request processed in 30us (824us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297191.872892:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789297191.872902:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789297191.872908:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957156224:12345-0@lo:400: 00000100:00100000:3.0:1789297191.872928:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957156224:12345-0@lo:400: Request processed in 21us (764us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297191.872934:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:3.0:1789297191.872947:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297191.872977:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957156224:0@lo:400: 00000100:00100000:3.0:1789297191.872986:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957156096:0@lo:400: 00000100:00100000:1.0:1789297191.873106:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156608 00000100:00100000:1.0:1789297191.873110:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156608 00000100:00100000:1.0:1789297191.873147:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297191.873155:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957156608:12345-0@lo:400: 00000100:00100000:1.0:1789297191.873958:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957156608:12345-0@lo:400: Request processed in 803us (1848us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297191.873967:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297191.874022:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957155968:0@lo:400: 00000100:00100000:1.0:1789297191.874037:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957156480:0@lo:400: 00000100:00080000:3.0:1789297191.874109:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789297191.874128:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b385a3100 x1876213957156608/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297207 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297191.874139:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:3.0:1789297191.874151:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957156608:0@lo:400: 00000100:00100000:3.0:1789297191.896925:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297191.897036:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933018240 00000100:00100000:0.0:1789297191.897046:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933018240 00000100:00100000:0.0:1789297191.897115:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:0.0:1789297191.897127:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:5674:x1876213933018240:12345-192.168.202.43@tcp:41: 00000004:00000024:0.0:1789297191.897165:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1789297191.897247:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:5674:x1876213933018240:12345-192.168.202.43@tcp:41: Request processed in 123us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297191.897268:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00080000:3.0:1789297191.897801:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297191.919788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297191.920398:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933018368 00000100:00100000:0.0:1789297191.920758:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933018368 00000100:00100000:0.0:1789297191.920852:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789297191.920869:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:235dd3df-f928-4719-bb69-fc817cc2744f+6:5674:x1876213933018368:12345-192.168.202.43@tcp:13: 00002000:00000024:0.0:1789297191.920919:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297191.921002:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:235dd3df-f928-4719-bb69-fc817cc2744f+6:5674:x1876213933018368:12345-192.168.202.43@tcp:13: Request processed in 138us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297191.921010:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00080000:3.0:1789297191.921180:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297191.923838:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297191.924689:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933018496 00000100:00100000:0.0:1789297191.924754:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933018496 00000100:00100000:0.0:1789297191.924854:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789297191.924867:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:235dd3df-f928-4719-bb69-fc817cc2744f+6:5674:x1876213933018496:12345-192.168.202.43@tcp:13: 00002000:00000024:0.0:1789297191.924933:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297191.925010:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:235dd3df-f928-4719-bb69-fc817cc2744f+6:5674:x1876213933018496:12345-192.168.202.43@tcp:13: Request processed in 145us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297191.925018:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00080000:3.0:1789297191.925312:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:3.0:1789297191.960055:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00010000:00010000:3.0:1789297192.381488:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297192.381751:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297192.381774:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957156736:0@lo:13: 00000100:00100000:1.0:1789297192.381844:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297192.382049:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156736 00000100:00100000:0.0:1789297192.382057:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156736 00000100:00100000:0.0:1789297192.382107:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789297192.382117:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957156736:12345-0@lo:13: 00002000:00000024:0.0:1789297192.382140:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297192.382205:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957156736:12345-0@lo:13: Request processed in 89us (361us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297192.382212:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00080000:1.0:1789297192.382467:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b385a1500 x1876213957156736/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297192.382501:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957156736:0@lo:13: 00000100:00100000:3.0:1789297192.902101:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957156864:0@lo:13: 00000100:00100000:3.0:1789297192.902174:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297192.902260:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156864 00000100:00100000:3.0:1789297192.902269:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156864 00000100:00100000:3.0:1789297192.902316:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789297192.902325:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957156864:12345-0@lo:13: 00002000:00000024:3.0:1789297192.902348:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297192.902390:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957156864:12345-0@lo:13: Request processed in 66us (216us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297192.902397:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00080000:3.0:1789297192.902436:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b385a1c00 x1876213957156864/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297192.902473:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957156864:0@lo:13: 00010000:00010000:2.0:1789297193.412191:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789297194.014846:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000001:00100000:3.0:1789297194.039151:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00010000:00010000:1.0:1789297194.428887:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297194.993846:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297194.993882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297194.993912:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297194.993954:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297194.993983:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019008 00000100:00100000:0.0:1789297194.993993:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019008 00000100:00100000:0.0:1789297194.994070:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933018880 00000100:00100000:0.0:1789297194.994074:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933018880 00000100:00100000:0.0:1789297194.994095:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789297194.994105:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933019008:12345-192.168.202.43@tcp:400: 00000100:00100000:0.0:1789297194.994188:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933019008:12345-192.168.202.43@tcp:400: Request processed in 84us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297194.994196:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789297194.994212:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789297194.994219:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933018880:12345-192.168.202.43@tcp:400: 00000100:00100000:0.0:1789297194.994244:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933018880:12345-192.168.202.43@tcp:400: Request processed in 26us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297194.994251:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789297194.994284:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933018624 00000100:00100000:0.0:1789297194.994288:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933018624 00000100:00100000:0.0:1789297194.994312:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:0.0:1789297194.994319:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2354:x1876213933018624:12345-192.168.202.43@tcp:400: 00000100:00100000:0.0:1789297194.994343:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2354:x1876213933018624:12345-192.168.202.43@tcp:400: Request processed in 24us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297194.994349:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:3.0:1789297194.995302:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933018752 00000100:00100000:3.0:1789297194.995310:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933018752 00000100:00100000:3.0:1789297194.995359:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:3.0:1789297194.995369:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933018752:12345-192.168.202.43@tcp:400: 00000100:00100000:3.0:1789297194.995411:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933018752:12345-192.168.202.43@tcp:400: Request processed in 45us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297194.995417:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00080000:3.0:1789297194.995435:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789297194.995439:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297194.995441:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:02000400:3.0:1789297195.432556:0:8298:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1789297195.454599:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297196.480856:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297196.991124:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297196.991158:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957156992:0@lo:400: 00000100:00100000:1.0:1789297196.991231:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297196.991300:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957156992 00000100:00100000:2.0:1789297196.991310:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957156992 00000100:00100000:1.0:1789297196.991317:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957157120:0@lo:400: 00000100:00100000:1.0:1789297196.991344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297196.991372:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:2.0:1789297196.991381:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957156992:12345-0@lo:400: 00000100:00100000:1.0:1789297196.991388:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957157248:0@lo:400: 00000100:00100000:1.0:1789297196.991424:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297196.991452:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957157120 00000100:00100000:1.0:1789297196.991456:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957157120 00000100:00100000:1.0:1789297196.991487:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957157248 00000100:00100000:1.0:1789297196.991491:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957157248 00000100:00100000:1.0:1789297196.991530:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789297196.991538:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957157120:12345-0@lo:400: 00000100:00100000:1.0:1789297196.991571:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957157120:12345-0@lo:400: Request processed in 35us (226us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297196.991578:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789297196.991596:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789297196.991606:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957156992:12345-0@lo:400: Request processed in 227us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297196.991609:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957157248:12345-0@lo:400: 00000100:00100000:2.0:1789297196.991612:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:1.0:1789297196.991640:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957157248:12345-0@lo:400: Request processed in 31us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297196.991645:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1789297196.991657:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957156992:0@lo:400: 00000100:00080000:1.0:1789297196.991663:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297196.991679:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957157120:0@lo:400: 00000100:00100000:1.0:1789297196.991700:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957157248:0@lo:400: 00000100:00100000:1.0:1789297196.991786:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957157632:0@lo:400: 00000100:00100000:1.0:1789297196.991811:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297196.992100:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957157504:0@lo:400: 00000100:00100000:2.0:1789297196.992127:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297196.992174:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789297196.992180:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957157376:0@lo:400: 00000100:00100000:2.0:1789297196.992204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297196.992229:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957157632 00000100:00100000:2.0:1789297196.992233:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957157632 00000100:00100000:2.0:1789297196.992262:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957157376 00000100:00100000:2.0:1789297196.992265:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957157376 00000100:00100000:2.0:1789297196.992278:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789297196.992285:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957157632:12345-0@lo:400: 00000100:00100000:2.0:1789297196.992318:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957157632:12345-0@lo:400: Request processed in 34us (507us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297196.992324:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789297196.992334:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1789297196.992340:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957157376:12345-0@lo:400: 00000100:00100000:0.0:1789297196.992362:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957157504 00000100:00100000:2.0:1789297196.992366:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957157376:12345-0@lo:400: Request processed in 27us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297196.992371:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789297196.992373:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957157504 00010000:00080000:2.0:1789297196.992398:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef4380 x1876213957157376/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297196.992411:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789297196.992419:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957157504:12345-0@lo:400: 00000100:00100000:2.0:1789297196.992440:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957157376:0@lo:400: 00000100:00100000:0.0:1789297196.992450:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957157504:12345-0@lo:400: Request processed in 33us (323us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297196.992456:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789297196.992636:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957157504:0@lo:400: 00000100:00080000:2.0:1789297196.992655:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789297196.992658:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789297196.992660:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789297196.992674:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef7800 x1876213957157632/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297212 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297196.992682:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957157632:0@lo:400: 00010000:00010000:1.0:1789297197.500830:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297197.502043:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789297197.502066:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957157760:0@lo:13: 00000100:00100000:2.0:1789297197.502137:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297197.502207:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957157760 00000100:00100000:1.0:1789297197.502216:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957157760 00000100:00100000:1.0:1789297197.502285:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297197.502298:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957157760:12345-0@lo:13: 00002000:00000024:1.0:1789297197.502337:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297197.502392:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024be680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957157760:12345-0@lo:13: Request processed in 97us (254us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297197.502400:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:1.0:1789297197.502576:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bea00 x1876213957157760/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297197.502606:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957157760:0@lo:13: 00000100:00100000:3.0:1789297198.017807:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957157888:0@lo:13: 00000100:00100000:3.0:1789297198.017884:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297198.018202:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957157888 00000100:00100000:1.0:1789297198.018213:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957157888 00000100:00100000:1.0:1789297198.018296:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297198.018312:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957157888:12345-0@lo:13: 00002000:00000024:1.0:1789297198.018349:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789297198.018847:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297198.019877:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957157888:12345-0@lo:13: Request processed in 1558us (1978us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297198.019890:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789297198.019891:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3b80 x1876213957157888/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297198.019916:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957157888:0@lo:13: 00010000:00010000:3.0:1789297198.525096:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789297199.237446:0:8446:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc14e43900 20000000:00000080:2.0:1789297199.237465:0:8446:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982b387d3400 uarg=0000000000000000 20000000:01000000:2.0:1789297199.237496:0:8446:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:2.0:1789297199.237498:0:8446:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:2.0:1789297199.237501:0:8446:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789297199.237506:0:8446:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:2.0:1789297199.237511:0:8446:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:2.0:1789297199.237524:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1789297199.237526:0:8446:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1789297199.237935:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1789297199.237939:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789297199.239278:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:2.0:1789297199.240106:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:2.0:1789297199.240173:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:2.0:1789297199.240210:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 20000000:01000000:2.0:1789297199.240224:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1789297199.240226:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789297199.241259:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:2.0:1789297199.241652:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:2.0:1789297199.242257:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:2.0:1789297199.242300:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:2.0:1789297199.242317:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1789297199.242319:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789297199.243657:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:3.0:1789297199.244425:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:3.0:1789297199.244664:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:3.0:1789297199.245095:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:3.0:1789297199.245113:0:8446:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1789297199.245116:0:8446:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:0.0:1789297199.247181:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1789297199.248154:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1789297199.248228:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1789297199.248270:0:8446:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 10000000:01000000:3.0:1789297199.248287:0:8446:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1789297199.248307:0:8446:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248326:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248333:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248339:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248346:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248360:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248367:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248374:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248383:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248389:0:8446:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248396:0:8446:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248435:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248451:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 9 pid: 5837 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.248467:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158016:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297199.248580:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248588:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 9 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.248605:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158144:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297199.248638:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248646:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 18 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.248655:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158272:0@lo:104: 00000100:00100000:3.0:1789297199.248694:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789297199.248761:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248770:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 18 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.248788:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158400:0@lo:104: 00000100:00100000:3.0:1789297199.248811:0:8446:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789297199.248831:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.248839:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 18 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.248963:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158528:0@lo:104: 00010000:00010000:3.0:1789297199.248993:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.249112:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 18 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.249139:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158656:0@lo:104: 00010000:00010000:3.0:1789297199.249166:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.249174:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 18 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.249182:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158784:0@lo:104: 00010000:00010000:3.0:1789297199.249203:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.249210:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 18 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.249216:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158912:0@lo:104: 00010000:00010000:3.0:1789297199.249235:0:8446:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.249242:0:8446:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 18 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.249249:0:8446:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957159040:0@lo:104: 00000100:00100000:3.0:1789297199.249264:0:8446:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1cc00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297199.249359:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789297199.249378:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.249391:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.249399:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.249408:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.249415:0:5825:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.249423:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957158272 00000100:00100000:1.0:1789297199.249429:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957158272 00000100:00100000:1.0:1789297199.249469:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957158400 00000100:00100000:1.0:1789297199.249472:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957158400 00000100:00100000:1.0:1789297199.249482:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957158528 00000100:00100000:1.0:1789297199.249484:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957158528 00000100:00100000:1.0:1789297199.249492:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957158656 00000100:00100000:1.0:1789297199.249494:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957158656 00000100:00100000:1.0:1789297199.249501:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957158784 00000100:00100000:1.0:1789297199.249503:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957158784 00000100:00100000:1.0:1789297199.249511:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957158912 00000100:00100000:1.0:1789297199.249513:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957158912 00000100:00100000:1.0:1789297199.249521:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159040 00000100:00100000:1.0:1789297199.249523:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159040 00000100:00100000:1.0:1789297199.249536:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297199.249545:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:8446:x1876213957158272:12345-0@lo:104: 00010000:00010000:1.0:1789297199.249558:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.249619:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789297199.249625:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+9:8446:x1876213957158272:12345-0@lo:104: Request processed in 82us (932us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.249632:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297199.249655:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297199.249661:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+8:8446:x1876213957158400:12345-0@lo:104: 00010000:00010000:1.0:1789297199.249669:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.249734:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789297199.249740:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cebc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+8:8446:x1876213957158400:12345-0@lo:104: Request processed in 80us (928us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.249747:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297199.249792:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789297199.249799:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+7:8446:x1876213957158528:12345-0@lo:104: 00010000:00010000:1.0:1789297199.249805:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.249836:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789297199.249841:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+7:8446:x1876213957158528:12345-0@lo:104: Request processed in 44us (463us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.249959:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789297199.249973:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789297199.249980:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+6:8446:x1876213957158656:12345-0@lo:104: 00010000:00010000:1.0:1789297199.249988:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250278:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:1.0:1789297199.250284:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+6:8446:x1876213957158656:12345-0@lo:104: Request processed in 305us (892us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.250290:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789297199.250308:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789297199.250315:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:8446:x1876213957158784:12345-0@lo:104: 00010000:00010000:1.0:1789297199.250323:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250349:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:1.0:1789297199.250353:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:8446:x1876213957158784:12345-0@lo:104: Request processed in 40us (954us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.250359:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789297199.250368:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789297199.250374:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:8446:x1876213957158912:12345-0@lo:104: 00010000:00010000:1.0:1789297199.250381:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250404:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/6 locks to priority blp list, 6 blwis in pool 00000100:00100000:1.0:1789297199.250409:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:8446:x1876213957158912:12345-0@lo:104: Request processed in 36us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.250415:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789297199.250425:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789297199.250432:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:8446:x1876213957159040:12345-0@lo:104: 00010000:00010000:1.0:1789297199.250439:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250461:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/7 locks to priority blp list, 7 blwis in pool 00000100:00100000:1.0:1789297199.250466:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:8446:x1876213957159040:12345-0@lo:104: Request processed in 36us (1050us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.250472:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789297199.250497:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 6 total in blp. (6 blwis in pool) 00010000:00010000:1.0:1789297199.250503:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250511:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031800 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297199.250515:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250525:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297199.250532:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297199.250539:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789297199.250579:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250587:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297199.250601:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250609:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b00031800/0x8ad177e823a0b3b0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b3b7 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250621:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 5 total in blp. (5 blwis in pool) 00010000:00010000:1.0:1789297199.250625:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250631:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297199.250635:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250647:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297199.250654:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297199.250660:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789297199.250672:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250679:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297199.250692:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250700:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063000/0x8ad177e823a0b386 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b38d expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250737:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:1.0:1789297199.250740:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250746:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297199.250750:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250757:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297199.250763:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297199.250774:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1789297199.250786:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250791:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297199.250796:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250803:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152a400/0x8ad177e823a0b36a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b371 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250813:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:1.0:1789297199.250816:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250821:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20062800 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297199.250824:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.250831:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297199.250837:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297199.250842:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789297199.250942:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789297199.250947:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.250953:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297199.250962:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.250969:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297199.250975:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297199.250980:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789297199.250994:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251139:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297199.251146:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251153:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152b400/0x8ad177e823a0b34e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b355 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251163:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789297199.251166:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251172:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152ba00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297199.251175:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251182:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297199.251198:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297199.251203:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789297199.251218:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251224:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297199.251229:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251235:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b324 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b32b expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251246:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297199.251249:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251253:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063200 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297199.251256:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251261:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297199.251267:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297199.251271:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1789297199.251289:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251294:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297199.251299:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251304:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b2fa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b301 expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251312:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297199.251314:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297199.251315:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297199.251331:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957159168:0@lo:103: 00000100:00100000:3.0:1789297199.251369:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297199.251408:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957159680:0@lo:103: 00000100:00100000:3.0:1789297199.251427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297199.251446:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297199.251451:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957159552:0@lo:103: 00000100:00100000:3.0:1789297199.251469:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297199.251497:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159168 00000100:00100000:3.0:1789297199.251503:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159168 00010000:00010000:3.0:1789297199.251525:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 19 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.251545:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159680 00000100:00100000:3.0:1789297199.251548:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159680 00010000:00010000:3.0:1789297199.251557:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 20 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.251568:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159552 00000100:00100000:3.0:1789297199.251576:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159552 00010000:00010000:3.0:1789297199.251586:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 21 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.251599:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789297199.251605:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3305:x1876213957159168:12345-0@lo:103: 00010000:00010000:3.0:1789297199.251616:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297199.251621:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 21 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251629:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 21 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251646:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297199.251673:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3305:x1876213957159168:12345-0@lo:103: Request processed in 69us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297199.251679:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789297199.251693:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789297199.251697:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3305:x1876213957159680:12345-0@lo:103: 00010000:00010000:3.0:1789297199.251727:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297199.251731:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 20 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251740:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 20 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251748:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297199.251768:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3305:x1876213957159680:12345-0@lo:103: Request processed in 70us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297199.251773:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789297199.251807:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297199.251813:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957159552:12345-0@lo:103: 00010000:00010000:3.0:1789297199.251820:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297199.251825:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 19 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251833:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 19 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.251841:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297199.254556:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.254573:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297199.254598:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.254605:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20062800/0x8ad177e823a0b35c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b363 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.254626:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297199.254628:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297199.254630:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297199.254649:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957159296:0@lo:103: 00000100:00100000:0.0:1789297199.254764:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957159424:0@lo:103: 00000100:00100000:0.0:1789297199.254807:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297199.254843:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957159936:0@lo:103: 00000100:00100000:0.0:1789297199.254875:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.255248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.255265:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957159808:0@lo:103: 00000100:00100000:1.0:1789297199.255291:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297199.256100:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159424 00000100:00100000:1.0:1789297199.256110:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159424 00000100:00100000:3.0:1789297199.256505:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3305:x1876213957159552:12345-0@lo:103: Request processed in 4689us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297199.256520:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297199.256543:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159936 00000100:00100000:3.0:1789297199.256546:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159936 00010000:00010000:3.0:1789297199.256564:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 20 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.256580:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159296 00000100:00100000:3.0:1789297199.256583:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159296 00010000:00010000:3.0:1789297199.256593:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 21 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.256602:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957159808 00000100:00100000:3.0:1789297199.256604:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957159808 00010000:00010000:3.0:1789297199.256612:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 22 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.256625:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789297199.256632:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+22:3303:x1876213957159936:12345-0@lo:103: 00010000:00010000:3.0:1789297199.256645:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297199.256660:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 22 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.256671:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 22 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.256691:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297199.256766:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+22:3303:x1876213957159936:12345-0@lo:103: Request processed in 134us (1889us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297199.256773:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00010000:1.0:1789297199.256825:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 22 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297199.256950:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957159936:0@lo:103: 00000100:00100000:1.0:1789297199.257439:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789297199.257452:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3302:x1876213957159296:12345-0@lo:103: 00010000:00010000:1.0:1789297199.257464:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297199.257469:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 21 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.257478:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 21 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.257489:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297199.257536:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3302:x1876213957159296:12345-0@lo:103: Request processed in 90us (2288us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.257555:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1789297199.257571:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789297199.257578:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3302:x1876213957159808:12345-0@lo:103: 00010000:00010000:1.0:1789297199.257586:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297199.257591:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 20 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.257599:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 20 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.257609:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297199.257631:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3302:x1876213957159808:12345-0@lo:103: Request processed in 55us (2340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.257637:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789297199.257649:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789297199.257655:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957159424:12345-0@lo:103: 00010000:00010000:1.0:1789297199.257665:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297199.257669:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 19 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.257676:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 19 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297199.257685:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297199.257746:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957159424:12345-0@lo:103: Request processed in 91us (2938us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297199.257753:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:1.0:1789297199.257815:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297199.258053:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957159424:0@lo:103: 00000100:00100000:2.0:1789297199.258082:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957159296:0@lo:103: 00000100:00100000:2.0:1789297199.258091:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957159808:0@lo:103: 00000100:00100000:1.0:1789297199.258440:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297199.258476:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297199.258531:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019136 00000100:00100000:0.0:1789297199.258537:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019136 00010000:00010000:0.0:1789297199.258565:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 10 pid: 5837 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297199.258582:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019264 00000100:00100000:0.0:1789297199.258584:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019264 00010000:00010000:0.0:1789297199.258595:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 11 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297199.258608:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:0.0:1789297199.258615:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:2353:x1876213933019136:12345-192.168.202.43@tcp:103: 00010000:00010000:0.0:1789297199.258625:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297199.258629:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 11 pid: 5837 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297199.258646:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 11 pid: 5837 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297199.258658:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297199.258970:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789297199.258980:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:2353:x1876213933019264:12345-192.168.202.43@tcp:103: 00010000:00010000:2.0:1789297199.258989:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297199.258994:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 11 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259013:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 11 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259026:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259035:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259050:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259057:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259075:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259081:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259088:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297199.259092:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259100:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259110:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297199.259120:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297199.259200:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:2353:x1876213933019136:12345-192.168.202.43@tcp:103: Request processed in 584us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297199.259208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789297199.259425:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957159552:0@lo:103: 00000100:00100000:3.0:1789297199.259437:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957159168:0@lo:103: 00000100:00100000:3.0:1789297199.259446:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957159680:0@lo:103: 00010000:00010000:3.0:1789297199.259485:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152be00/0x8ad177e823a0b3cc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7da expref: 10 pid: 5837 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259498:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158016:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297199.259508:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b3c5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d7d3 expref: 9 pid: 5835 timeout: 311 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259516:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158144:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297199.259527:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063800/0x8ad177e823a0b3b7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b3b0 expref: 18 pid: 5836 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259536:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b2d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158272:0@lo:104: 00010000:00010000:3.0:1789297199.259545:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062200/0x8ad177e823a0b38d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b386 expref: 17 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259565:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158400:0@lo:104: 00010000:00010000:3.0:1789297199.259577:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42176800/0x8ad177e823a0b371 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b36a expref: 16 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259586:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0e00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158528:0@lo:104: 00010000:00010000:3.0:1789297199.259594:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152a800/0x8ad177e823a0b363 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b35c expref: 15 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259602:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158656:0@lo:104: 00010000:00010000:3.0:1789297199.259611:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031e00/0x8ad177e823a0b355 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b34e expref: 14 pid: 5835 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259620:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158784:0@lo:104: 00010000:00010000:3.0:1789297199.259630:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42177800/0x8ad177e823a0b32b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b324 expref: 13 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259638:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b2300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957158912:0@lo:104: 00010000:00010000:3.0:1789297199.259646:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062400/0x8ad177e823a0b301 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b2fa expref: 12 pid: 5837 timeout: 361 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297199.259654:0:8446:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8446:1876213957159040:0@lo:104: 00010000:00010000:3.0:1789297199.259678:0:8446:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.259687:0:8446:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.259746:0:8446:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297199.259753:0:8446:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b404 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8446 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297199.267271:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:2353:x1876213933019264:12345-192.168.202.43@tcp:103: Request processed in 8278us (8778us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297199.267287:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00010000:00010000:3.0:1789297199.550298:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297200.107899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297200.107944:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297200.107991:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297200.108079:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019520 00000100:00100000:3.0:1789297200.108090:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019520 00000100:00100000:3.0:1789297200.108162:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019648 00000100:00100000:3.0:1789297200.108166:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019648 00000100:00100000:3.0:1789297200.108186:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:3.0:1789297200.108196:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933019520:12345-192.168.202.43@tcp:400: 00000100:00100000:3.0:1789297200.108293:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933019520:12345-192.168.202.43@tcp:400: Request processed in 97us (404us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297200.108301:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:3.0:1789297200.108317:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:3.0:1789297200.108323:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933019648:12345-192.168.202.43@tcp:400: 00000100:00100000:3.0:1789297200.108347:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933019648:12345-192.168.202.43@tcp:400: Request processed in 25us (356us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297200.108353:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789297200.108484:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019392 00000100:00100000:1.0:1789297200.108489:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019392 00000100:00100000:1.0:1789297200.108532:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:1.0:1789297200.108545:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933019392:12345-192.168.202.43@tcp:400: 00000100:00100000:1.0:1789297200.108574:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933019392:12345-192.168.202.43@tcp:400: Request processed in 35us (629us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.108581:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00080000:0.0:1789297200.109129:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789297200.109135:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789297200.109137:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789297200.573190:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789297200.893057:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1789297200.893067:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982a01db8800 from 39 10000000:01000000:0.0:1789297200.893073:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1789297200.893130:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.893142:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.893153:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297200.893176:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160064:0@lo:101: 00000100:00100000:0.0:1789297200.893307:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.893419:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08600 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.898201:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160064 00000100:00100000:2.0:1789297200.898215:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160064 00000100:00100000:2.0:1789297200.898409:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1789297200.898420:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+12:5839:x1876213957160064:12345-0@lo:101: 00010000:00010000:2.0:1789297200.898453:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297200.898474:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20062a00/0x8ad177e823a0b412 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b40b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.898503:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062a00/0x8ad177e823a0b412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b40b expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.898530:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20062a00/0x8ad177e823a0b412 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b40b expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.898540:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20062a00, rc 0) 00000100:00100000:2.0:1789297200.898628:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957160064:12345-0@lo:101: Request processed in 209us (5320us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.898635:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:0.0:1789297200.898764:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160064:0@lo:101: 00010000:00010000:0.0:1789297200.898787:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.898797:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297200.898874:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160192:0@lo:501: 00000100:00100000:0.0:1789297200.898909:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.899682:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08600 going to sleep for 11 seconds 00000100:00100000:1.0:1789297200.899872:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160192 00000100:00100000:1.0:1789297200.899879:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160192 00000100:00100000:1.0:1789297200.899913:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789297200.899922:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957160192:12345-0@lo:501: 00000100:00100000:1.0:1789297200.900192:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957160192:12345-0@lo:501: Request processed in 271us (1281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.900200:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:0.0:1789297200.900389:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160192:0@lo:501: 00000100:00100000:0.0:1789297200.900426:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160320:0@lo:503: 00000100:00100000:0.0:1789297200.900478:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.900506:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08600 going to sleep for 11 seconds 00000100:00100000:1.0:1789297200.900659:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160320 00000100:00100000:1.0:1789297200.900664:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160320 00000100:00100000:1.0:1789297200.900684:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789297200.900690:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957160320:12345-0@lo:503: 00000100:00100000:1.0:1789297200.901064:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957160320:12345-0@lo:503: Request processed in 373us (584us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.901072:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1789297200.901187:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160320:0@lo:503: 00000100:00100000:3.0:1789297200.902158:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8462:1876213957160448:0@lo:502: 00000100:00100000:3.0:1789297200.902215:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297200.902853:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.903035:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160448 00000100:00100000:2.0:1789297200.903042:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160448 00000100:00100000:2.0:1789297200.903139:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1789297200.903149:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:8462:x1876213957160448:12345-0@lo:502: 00000100:00100000:2.0:1789297200.903421:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:8462:x1876213957160448:12345-0@lo:502: Request processed in 273us (1205us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.903429:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:3.0:1789297200.903630:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8462:1876213957160448:0@lo:502: 00000100:00100000:3.0:1789297200.903677:0:8462:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8462:1876213957160576:0@lo:502: 00000100:00100000:3.0:1789297200.903799:0:8462:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297200.903880:0:8462:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.904091:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160576 00000100:00100000:2.0:1789297200.904096:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160576 00000100:00100000:2.0:1789297200.904139:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1789297200.904147:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:8462:x1876213957160576:12345-0@lo:502: 00000100:00100000:2.0:1789297200.904406:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:8462:x1876213957160576:12345-0@lo:502: Request processed in 258us (605us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.904414:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:3.0:1789297200.904550:0:8462:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8462:1876213957160576:0@lo:502: 00000040:00080000:3.0:1789297200.904571:0:8462:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789297200.904975:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789297200.904993:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789297200.905004:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.905016:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297200.905034:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1789297200.905036:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1789297200.905039:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1789297200.905067:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.905075:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.905085:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297200.905100:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160704:0@lo:101: 00000100:00100000:2.0:1789297200.905144:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297200.905212:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789297200.905301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160704 00000100:00100000:1.0:1789297200.905308:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160704 00000100:00100000:1.0:1789297200.905350:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789297200.905359:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+13:5839:x1876213957160704:12345-0@lo:101: 00010000:00010000:1.0:1789297200.905378:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297200.905390:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42176600/0x8ad177e823a0b420 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b419 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297200.905413:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42176600/0x8ad177e823a0b420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b419 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297200.905424:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42176600/0x8ad177e823a0b420 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b419 expref: 14 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297200.905432:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42176600, rc 0) 00000100:00100000:1.0:1789297200.906116:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957160704:12345-0@lo:101: Request processed in 748us (960us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.906124:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:2.0:1789297200.906216:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160704:0@lo:101: 00010000:00010000:2.0:1789297200.906230:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.906304:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297200.906358:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160832:0@lo:501: 00000100:00100000:2.0:1789297200.906384:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297200.906461:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297200.906838:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160832 00000100:00100000:0.0:1789297200.906844:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160832 00000100:00100000:0.0:1789297200.907020:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1789297200.907030:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957160832:12345-0@lo:501: 00000100:00100000:0.0:1789297200.907349:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957160832:12345-0@lo:501: Request processed in 320us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297200.907356:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:3.0:1789297200.907418:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160832:0@lo:501: 00000100:00100000:3.0:1789297200.907649:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160960:0@lo:503: 00000100:00100000:3.0:1789297200.907691:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297200.907996:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1c3c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.908193:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957160960 00000100:00100000:2.0:1789297200.908199:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957160960 00000100:00100000:2.0:1789297200.908229:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1789297200.908308:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957160960:12345-0@lo:503: 00000100:00100000:2.0:1789297200.908653:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957160960:12345-0@lo:503: Request processed in 347us (960us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.908660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:3.0:1789297200.912218:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957160960:0@lo:503: 00000100:00100000:0.0:1789297200.916310:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8463:1876213957161088:0@lo:502: 00000100:00100000:0.0:1789297200.916426:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.916486:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08180 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.916651:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161088 00000100:00100000:2.0:1789297200.916661:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161088 00000100:00100000:2.0:1789297200.916751:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1789297200.916761:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:8463:x1876213957161088:12345-0@lo:502: 00000100:00100000:2.0:1789297200.916991:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:8463:x1876213957161088:12345-0@lo:502: Request processed in 230us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.916999:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1789297200.917227:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8463:1876213957161088:0@lo:502: 00000020:01000000:1.0:1789297200.917267:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789297200.917277:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297200.917280:0:8463:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1789297200.917286:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1789297200.917310:0:8463:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8463:1876213957161216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.917347:0:8463:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.917379:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161216 00000100:00100000:1.0:1789297200.917384:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161216 00000100:00100000:1.0:1789297200.917415:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789297200.917422:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:8463:x1876213957161216:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.917562:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:8463:x1876213957161216:12345-0@lo:502:llog_process_th.0 Request processed in 140us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.917572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:1.0:1789297200.917615:0:8463:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad50c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297200.917630:0:8463:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8463:1876213957161216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789297200.917650:0:8463:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297200.917654:0:8463:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297200.917655:0:8463:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1789297200.917659:0:8463:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1789297200.918944:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1789297200.918969:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1789297200.918980:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.918993:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297200.919003:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1789297200.919006:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b121d2000 from 39 10000000:01000000:2.0:1789297200.919009:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789297200.919040:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.919049:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.919061:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297200.919090:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161344:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.919152:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297200.919186:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.919204:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161344 00000100:00100000:2.0:1789297200.919209:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161344 00000100:00100000:2.0:1789297200.919415:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789297200.919424:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:5839:x1876213957161344:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297200.919452:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297200.919466:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20063800/0x8ad177e823a0b42e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b427 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.919489:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063800/0x8ad177e823a0b42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b427 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.919502:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20063800/0x8ad177e823a0b42e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b427 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.919511:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20063800, rc 0) 00000100:00100000:2.0:1789297200.919544:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957161344:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (392us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.919551:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:2.0:1789297200.920694:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161344:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297200.921057:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.921070:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297200.921166:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.921380:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297200.921518:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297200.921560:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161472 00000100:00100000:0.0:1789297200.921566:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161472 00000100:00100000:0.0:1789297200.921648:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789297200.921656:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957161472:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.921990:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957161472:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 325us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297200.921998:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1789297200.922065:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161472:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.922095:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.922144:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.923363:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161600 00000100:00100000:1.0:1789297200.923371:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161600 00000100:00100000:1.0:1789297200.923420:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:1.0:1789297200.923430:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957161600:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.923612:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957161600:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 183us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.923620:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1789297200.923762:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7840 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.923780:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161600:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.924537:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8464:1876213957161728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.924586:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.924618:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad56c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.924668:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161728 00000100:00100000:2.0:1789297200.924673:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161728 00000100:00100000:2.0:1789297200.924696:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1789297200.924739:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:8464:x1876213957161728:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297200.924946:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:8464:x1876213957161728:12345-0@lo:502:llog_process_th.0 Request processed in 243us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.924954:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789297200.925485:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8464:1876213957161728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.925531:0:8464:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8464:1876213957161856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.925566:0:8464:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.925589:0:8464:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b13b3c780 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.925643:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161856 00000100:00100000:2.0:1789297200.925648:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161856 00000100:00100000:2.0:1789297200.925669:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789297200.925675:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:8464:x1876213957161856:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297200.925865:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:8464:x1876213957161856:12345-0@lo:502:llog_process_th.0 Request processed in 189us (297us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.926103:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:1.0:1789297200.926211:0:8464:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8464:1876213957161856:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789297200.926328:0:8464:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1789297200.926700:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1789297200.926752:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1789297200.926762:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.926773:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297200.926783:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1789297200.926786:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1789297200.926789:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789297200.926816:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.926823:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.926843:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297200.926860:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161984:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.926901:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297200.927194:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.927210:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957161984 00000100:00100000:2.0:1789297200.927227:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957161984 00000100:00100000:2.0:1789297200.927255:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789297200.927263:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:5839:x1876213957161984:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297200.927273:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297200.927287:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20062800/0x8ad177e823a0b43c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b435 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.927324:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062800/0x8ad177e823a0b43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b435 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.927336:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20062800/0x8ad177e823a0b43c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b435 expref: 16 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.927344:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20062800, rc 0) 00000100:00100000:2.0:1789297200.927379:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957161984:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 116us (476us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.927386:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789297200.927579:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957161984:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297200.927593:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.927602:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297200.927650:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.927678:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297200.927691:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.927732:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957162112 00000100:00100000:2.0:1789297200.927736:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957162112 00000100:00100000:2.0:1789297200.927753:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789297200.927758:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957162112:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.928343:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957162112:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 582us (662us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.928360:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1789297200.928392:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162112:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.928495:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.928533:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297200.928547:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.928560:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957162240 00000100:00100000:2.0:1789297200.928563:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957162240 00000100:00100000:2.0:1789297200.928580:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:2.0:1789297200.928586:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957162240:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297200.929835:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957162240:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1245us (1298us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.929845:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789297200.930064:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162240:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.931098:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8465:1876213957162368:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297200.931173:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.931220:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08b40 going to sleep for 11 seconds 00000100:00100000:3.0:1789297200.931309:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957162368 00000100:00100000:3.0:1789297200.931315:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957162368 00000100:00100000:3.0:1789297200.931348:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789297200.931354:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:8465:x1876213957162368:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297200.931623:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:8465:x1876213957162368:12345-0@lo:502:llog_process_th.0 Request processed in 267us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297200.931630:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789297200.931655:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8465:1876213957162368:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297200.931682:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297200.931693:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297200.931695:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789297200.931701:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789297200.931819:0:8465:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8465:1876213957162496:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297200.932121:0:8465:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.932148:0:8465:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.932301:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957162496 00000100:00100000:2.0:1789297200.932305:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957162496 00000100:00100000:2.0:1789297200.932332:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1789297200.932337:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:8465:x1876213957162496:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297200.932463:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:8465:x1876213957162496:12345-0@lo:502:llog_process_th.0 Request processed in 124us (355us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.932470:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:0.0:1789297200.932491:0:8465:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8465:1876213957162496:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297200.932512:0:8465:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297200.932517:0:8465:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297200.932519:0:8465:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789297200.932523:0:8465:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:1.0:1789297200.932677:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:1.0:1789297200.932698:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1789297200.932794:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297200.932806:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297200.932816:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:1.0:1789297200.932819:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b07359800 from 39 10000000:01000000:1.0:1789297200.932822:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1789297200.933066:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297200.933075:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297200.933085:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297200.933102:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.933148:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.933186:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297200.933307:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957162624 00000100:00100000:3.0:1789297200.933311:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957162624 00000100:00100000:3.0:1789297200.933338:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1789297200.933343:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957162624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789297200.933350:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297200.933361:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b44a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b443 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297200.933379:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b443 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297200.933393:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b44a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b443 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297200.933399:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a200, rc 0) 00000100:00100000:1.0:1789297200.933485:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297200.933498:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297200.933502:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957162624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (288us total) trans 0 rc 0/0 00010000:00010000:1.0:1789297200.933508:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297200.933509:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:1.0:1789297200.933547:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.933582:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.933644:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad56c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297200.933673:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957162752 00000100:00100000:3.0:1789297200.933677:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957162752 00000100:00100000:3.0:1789297200.933853:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:3.0:1789297200.933861:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957162752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297200.934240:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957162752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 379us (655us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297200.934247:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789297200.934302:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.934327:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.934362:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.944303:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297200.944599:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957162880 00000100:00100000:0.0:1789297200.944610:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957162880 00000100:00100000:0.0:1789297200.944658:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1789297200.944679:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957162880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.945914:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957162880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 1243us (11547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297200.945940:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789297200.949168:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957162880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.951935:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8466:1876213957163008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.952226:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.952270:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad56c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297200.952429:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163008 00000100:00100000:0.0:1789297200.952437:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163008 00000100:00100000:0.0:1789297200.952480:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1789297200.952491:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8466:x1876213957163008:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297200.952764:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8466:x1876213957163008:12345-0@lo:502:llog_process_th.0 Request processed in 274us (549us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297200.952772:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789297200.953161:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8466:1876213957163008:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.953232:0:8466:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8466:1876213957163136:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297200.953269:0:8466:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297200.953292:0:8466:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789297200.954780:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163136 00000100:00100000:0.0:1789297200.954793:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163136 00000100:00100000:0.0:1789297200.954850:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1789297200.954859:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8466:x1876213957163136:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297200.955510:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8466:x1876213957163136:12345-0@lo:502:llog_process_th.0 Request processed in 541us (2129us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297200.955519:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1789297200.955864:0:8466:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8466:1876213957163136:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1789297200.955908:0:8466:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:0.0:1789297200.956339:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:0.0:1789297200.956356:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789297200.956366:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.956377:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297200.956388:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:0.0:1789297200.956390:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:0.0:1789297200.956393:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:0.0:1789297200.956491:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.956508:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.956518:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297200.956541:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163264:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.956587:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.956618:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08840 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.956862:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163264 00000100:00100000:2.0:1789297200.957191:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163264 00000100:00100000:2.0:1789297200.957241:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:2.0:1789297200.957251:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957163264:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297200.957263:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297200.957277:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20063000/0x8ad177e823a0b458 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b451 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.957308:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063000/0x8ad177e823a0b458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b451 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.957319:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20063000/0x8ad177e823a0b458 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b451 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.957328:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20063000, rc 0) 00000100:00100000:2.0:1789297200.957371:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957163264:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 122us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297200.957377:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:0.0:1789297200.957821:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163264:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297200.957847:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.957858:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297200.958085:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.958131:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.958157:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297200.958353:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163392 00000100:00100000:1.0:1789297200.958359:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163392 00000100:00100000:1.0:1789297200.958387:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789297200.958396:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957163392:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.959084:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957163392:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 687us (949us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.959092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:0.0:1789297200.959533:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163392:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.959573:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.959614:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.959644:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297200.959864:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163520 00000100:00100000:1.0:1789297200.960058:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163520 00000100:00100000:1.0:1789297200.960150:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1789297200.960159:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957163520:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297200.960352:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957163520:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 194us (737us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297200.960359:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:0.0:1789297200.960434:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163520:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297200.960638:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8467:1876213957163648:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297200.960677:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.962530:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08180 going to sleep for 11 seconds 00000100:00100000:3.0:1789297200.962604:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163648 00000100:00100000:3.0:1789297200.962614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163648 00000100:00100000:3.0:1789297200.962680:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 159 00000100:00100000:3.0:1789297200.962688:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8467:x1876213957163648:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297200.963736:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8467:x1876213957163648:12345-0@lo:502:llog_process_th.0 Request processed in 1046us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297200.963746:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 159 00000100:00100000:0.0:1789297200.964176:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8467:1876213957163648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297200.964236:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297200.964246:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297200.964248:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1789297200.964256:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:0.0:1789297200.964292:0:8467:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8467:1876213957163776:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297200.964333:0:8467:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297200.964358:0:8467:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41e08180 going to sleep for 11 seconds 00000100:00100000:3.0:1789297200.964659:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163776 00000100:00100000:3.0:1789297200.964665:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163776 00000100:00100000:3.0:1789297200.965061:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:3.0:1789297200.965072:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8467:x1876213957163776:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297200.965468:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8467:x1876213957163776:12345-0@lo:502:llog_process_th.0 Request processed in 397us (1133us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297200.965475:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:0.0:1789297200.965563:0:8467:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8467:1876213957163776:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297200.965588:0:8467:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297200.965593:0:8467:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297200.965595:0:8467:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1789297200.965600:0:8467:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1789297200.966088:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:3.0:1789297200.966116:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1789297200.966126:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297200.966136:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297200.966146:0:5839:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:3.0:1789297200.966148:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982b18368000 from 1 10000000:01000000:3.0:1789297200.966151:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:3.0:1789297200.966292:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297200.966302:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297200.966312:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297200.966331:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789297200.966368:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297200.966466:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1789297200.966511:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957163904 00000100:00100000:0.0:1789297200.966516:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957163904 00000100:00100000:0.0:1789297200.966542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:0.0:1789297200.966550:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957163904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297200.966559:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297200.966571:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059baa00/0x8ad177e823a0b466 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b45f expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.966591:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059baa00/0x8ad177e823a0b466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b45f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.966600:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059baa00/0x8ad177e823a0b466 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b45f expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297200.966620:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059baa00, rc 0) 00000100:00100000:0.0:1789297200.967084:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957163904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 534us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297200.967092:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:3.0:1789297200.967495:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957163904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789297200.967511:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b466 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297200.967529:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b466 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297200.967579:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957164032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297200.967609:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297200.967672:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1789297200.968162:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164032 00000100:00100000:2.0:1789297200.968168:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164032 00000100:00100000:3.0:1789297200.968362:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789297200.968371:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957164032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297200.968603:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957164032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 233us (992us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789297200.968611:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1789297200.968858:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957164032:0@lo:501:ll_cfg_requeue.0 10000000:01000000:2.0:1789297200.969049:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789297200.969057:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b466 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297200.969066:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b466 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297201.598373:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297202.109377:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957164160:0@lo:400:kworker.0 00000100:00100000:0.0:1789297202.109377:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957164288:0@lo:400:kworker.0 00000100:00100000:1.0:1789297202.109388:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957164416:0@lo:400:kworker.0 00000100:00100000:2.0:1789297202.109408:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957164544:0@lo:400:kworker.0 00000100:00100000:3.0:1789297202.109465:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297202.109466:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297202.109528:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957164672:0@lo:400:kworker.0 00000100:00100000:0.0:1789297202.109530:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957164800:0@lo:400:kworker.0 00000100:00100000:3.0:1789297202.109569:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297202.109576:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297202.109625:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164800 00000100:00100000:3.0:1789297202.109633:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164800 00000100:00100000:0.0:1789297202.109633:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164160 00000100:00100000:0.0:1789297202.109640:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164160 00000100:00080000:0.0:1789297202.109691:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297202.109725:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789297202.109730:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164288 00000100:00100000:0.0:1789297202.109736:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957164160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297202.109737:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164288 00000100:00100000:1.0:1789297202.109774:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164672 00000100:00100000:1.0:1789297202.109779:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164672 00000100:00100000:0.0:1789297202.109796:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957164160:12345-0@lo:400:kworker.0 Request processed in 62us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297202.109805:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1789297202.109811:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789297202.109821:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957164288:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297202.109847:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957164160:0@lo:400:kworker.0 00000100:00100000:3.0:1789297202.109876:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297202.109878:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957164288:12345-0@lo:400:kworker.0 Request processed in 58us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297202.109888:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789297202.109891:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957164800:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297202.109910:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789297202.109922:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957164672:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789297202.109930:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297202.109936:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957164800:12345-0@lo:400:kworker.0 Request processed in 50us (360us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297202.109944:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:1.0:1789297202.109958:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bdc00 x1876213957164800/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297202.109973:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957164800:0@lo:400:kworker.0 00000100:00100000:0.0:1789297202.109973:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957164672:12345-0@lo:400:kworker.0 Request processed in 53us (402us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297202.109987:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297202.109996:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957164288:0@lo:400:kworker.0 00000100:00100000:1.0:1789297202.110049:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297202.110066:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164416 00000100:00100000:0.0:1789297202.110071:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164416 00000100:00100000:0.0:1789297202.110134:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789297202.110141:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957164416:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297202.110181:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957164416:12345-0@lo:400:kworker.0 Request processed in 41us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297202.110187:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789297202.110404:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957164672:0@lo:400:kworker.0 00000100:00080000:1.0:1789297202.110441:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297202.110463:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957164416:0@lo:400:kworker.0 00000100:00100000:2.0:1789297202.110496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297202.110527:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164544 00000100:00100000:0.0:1789297202.110532:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164544 00000100:00100000:0.0:1789297202.110574:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789297202.110580:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957164544:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789297202.110595:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789297202.110624:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957164544:12345-0@lo:400:kworker.0 Request processed in 44us (128us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297202.110633:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1789297202.110645:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bc380 x1876213957164544/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297218 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297202.110657:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957164544:0@lo:400:kworker.0 00000100:00100000:0.0:1789297202.620909:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789297202.620936:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957164928:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297202.621019:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297202.621110:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957164928 00000100:00100000:1.0:1789297202.621119:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957164928 00000100:00100000:1.0:1789297202.621180:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297202.621191:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957164928:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297202.621240:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297202.621297:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957164928:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297202.621304:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1789297202.621745:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bc380 x1876213957164928/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297202.621768:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957164928:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789297202.622187:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297203.137342:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297203.137372:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957165056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297203.137457:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297203.137645:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957165056 00000100:00100000:3.0:1789297203.137667:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957165056 00000100:00100000:3.0:1789297203.137764:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297203.137773:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957165056:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297203.137807:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297203.137850:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957165056:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (392us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297203.137858:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:1.0:1789297203.138047:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e17100 x1876213957165056/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297203.138075:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957165056:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297203.190639:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297203.191472:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019776 00000100:00100000:0.0:1789297203.191483:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019776 00000100:00100000:0.0:1789297203.191559:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:0.0:1789297203.191570:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:5598:x1876213933019776:12345-192.168.202.43@tcp:101: 00010000:00010000:0.0:1789297203.191590:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297203.191613:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bb800/0x8ad177e823a0b46d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d83c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297203.191664:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bb800/0x8ad177e823a0b46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d83c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297203.191677:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bb800/0x8ad177e823a0b46d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d83c expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297203.192004:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb800, rc 0) 00000100:00100000:0.0:1789297203.192138:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5598:x1876213933019776:12345-192.168.202.43@tcp:101: Request processed in 568us (1508us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297203.192145:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:1.0:1789297203.196843:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297203.196968:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933019904 00000100:00100000:3.0:1789297203.196979:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933019904 00000100:00100000:3.0:1789297203.197035:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:3.0:1789297203.197046:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5598:x1876213933019904:12345-192.168.202.43@tcp:501: 00000100:00100000:3.0:1789297203.197653:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5598:x1876213933019904:12345-192.168.202.43@tcp:501: Request processed in 606us (1131us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297203.197662:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:2.0:1789297203.212190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297203.212360:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020032 00000100:00100000:0.0:1789297203.212371:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020032 00000100:00100000:0.0:1789297203.212468:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 166 00000100:00100000:0.0:1789297203.212479:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5598:x1876213933020032:12345-192.168.202.43@tcp:503: 00000100:00100000:0.0:1789297203.213106:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5598:x1876213933020032:12345-192.168.202.43@tcp:503: Request processed in 626us (924us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297203.213114:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 166 00000100:00100000:1.0:1789297203.224337:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297203.224722:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020160 00000100:00100000:3.0:1789297203.224733:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020160 00000100:00100000:3.0:1789297203.224791:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 167 00000100:00100000:3.0:1789297203.224802:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:6081:x1876213933020160:12345-192.168.202.43@tcp:502: 00000100:00100000:3.0:1789297203.225109:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:6081:x1876213933020160:12345-192.168.202.43@tcp:502: Request processed in 307us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297203.225118:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 167 00000100:00100000:2.0:1789297203.240767:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297203.240905:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020288 00000100:00100000:0.0:1789297203.240915:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020288 00000100:00100000:0.0:1789297203.240974:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 168 00000100:00100000:0.0:1789297203.240986:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:6081:x1876213933020288:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297203.243279:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:6081:x1876213933020288:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 2273us (2499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297203.243294:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 168 00000100:00100000:2.0:1789297203.265565:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297203.266215:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020416 00000100:00100000:1.0:1789297203.266229:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020416 00000100:00100000:1.0:1789297203.266306:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 169 00000100:00100000:1.0:1789297203.266318:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5598:x1876213933020416:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297203.266336:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297203.266354:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42176c00/0x8ad177e823a0b474 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d843 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297203.266402:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42176c00/0x8ad177e823a0b474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d843 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297203.266414:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42176c00/0x8ad177e823a0b474 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d843 expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297203.266423:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42176c00, rc 0) 00000100:00100000:1.0:1789297203.266484:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933020416:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 168us (929us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297203.266491:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 169 00000100:00100000:1.0:1789297203.280759:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297203.280936:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020544 00000100:00100000:0.0:1789297203.280964:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020544 00000100:00100000:0.0:1789297203.281023:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 170 00000100:00100000:0.0:1789297203.281034:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933020544:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297203.281402:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933020544:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 368us (652us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789297203.281410:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 170 00010000:00010000:1.0:1789297203.649849:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297204.669025:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1789297204.836558:0:8507:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff1ecdd3b0 20000000:00000080:2.0:1789297204.836574:0:8507:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982b387d1000 uarg=0000000000000000 20000000:01000000:2.0:1789297204.836607:0:8507:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789297204.836613:0:8507:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789297204.836618:0:8507:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789297204.837607:0:8508:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1789297204.837909:0:8507:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:3.0:1789297204.842520:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:3.0:1789297204.842596:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:3.0:1789297204.842655:0:8507:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:3.0:1789297204.842674:0:8507:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1789297204.842694:0:8507:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.842758:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00030200/0x8ad177e823a0b1f0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.842767:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.842774:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.842783:0:8507:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.842791:0:8507:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.842863:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.842883:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 9 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297204.842900:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165184:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297204.843025:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.843034:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 18 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297204.843043:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165312:0@lo:104: 00000100:00100000:3.0:1789297204.843102:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789297204.843153:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297204.843160:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957165312 00010000:00010000:3.0:1789297204.843162:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 18 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297204.843168:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957165312 00000100:00100000:3.0:1789297204.843170:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165440:0@lo:104: 00000100:00100000:3.0:1789297204.843193:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789297204.843216:0:8507:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b00030200/0x8ad177e823a0b1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297204.843220:0:5825:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00010000:00010000:3.0:1789297204.843223:0:8507:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b00030200/0x8ad177e823a0b1f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 18 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297204.843229:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957165440 00000100:00100000:3.0:1789297204.843231:0:8507:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165568:0@lo:104: 00000100:00100000:0.0:1789297204.843232:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957165440 00000100:00100000:0.0:1789297204.843247:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789297204.843249:0:8507:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297204.843255:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:8507:x1876213957165312:12345-0@lo:104: 00000100:00100000:3.0:1789297204.843258:0:8507:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05798d80 going to sleep for 11 seconds 00010000:00010000:0.0:1789297204.843267:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843323:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789297204.843329:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:8507:x1876213957165312:12345-0@lo:104: Request processed in 75us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297204.843336:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1789297204.843351:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957165568 00000100:00100000:0.0:1789297204.843354:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957165568 00000100:00100000:0.0:1789297204.843367:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789297204.843372:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:8507:x1876213957165440:12345-0@lo:104: 00010000:00010000:0.0:1789297204.843379:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843411:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1789297204.843422:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40c9ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:8507:x1876213957165440:12345-0@lo:104: Request processed in 49us (227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297204.843427:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:0.0:1789297204.843460:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1789297204.843466:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:8507:x1876213957165568:12345-0@lo:104: 00010000:00010000:0.0:1789297204.843473:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843505:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1789297204.843510:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:8507:x1876213957165568:12345-0@lo:104: Request processed in 45us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297204.843515:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789297204.843530:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1789297204.843536:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843543:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00030400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297204.843547:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843555:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297204.843562:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297204.843568:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789297204.843597:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843612:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297204.843632:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843638:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0b316 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b31d expref: -99 pid: 7627 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843650:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789297204.843652:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843657:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063600 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297204.843660:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843666:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297204.843685:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297204.843690:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789297204.843701:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843724:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297204.843730:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843735:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063600/0x8ad177e823a0b24b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b252 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843749:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297204.843752:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843758:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20062c00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297204.843760:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843767:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297204.843773:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297204.843777:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1789297204.843790:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843795:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297204.843809:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843814:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20062c00/0x8ad177e823a0b1e9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b1f0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.843826:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297204.843828:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297204.843829:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297204.843835:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297204.843855:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297204.843873:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957165696:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297204.843900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297204.843920:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297204.843925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957165824:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297204.843956:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297204.843993:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957165952:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297204.844013:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297204.844043:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957165696 00000100:00100000:0.0:1789297204.844047:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957165696 00000100:00100000:2.0:1789297204.844059:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957165824 00000100:00100000:2.0:1789297204.844063:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957165824 00010000:00010000:0.0:1789297204.844063:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 19 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297204.844086:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 20 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297204.844091:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957165952 00000100:00100000:0.0:1789297204.844094:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957165952 00000100:00100000:2.0:1789297204.844100:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00010000:00010000:0.0:1789297204.844102:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00030200/0x8ad177e823a0b1f0 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 21 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297204.844106:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3304:x1876213957165696:12345-0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297204.844113:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00010000:00010000:2.0:1789297204.844116:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:0.0:1789297204.844118:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3304:x1876213957165824:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297204.844120:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 21 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.844124:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297204.844127:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 21 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297204.844129:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 21 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297204.844200:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165312:0@lo:104: 00000100:00100000:3.0:1789297204.844210:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165440:0@lo:104: 00000100:00100000:3.0:1789297204.844216:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165568:0@lo:104: 00010000:00010000:0.0:1789297204.847097:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 21 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297204.847153:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152aa00/0x8ad177e823a0b31d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b316 expref: 21 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297204.848824:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297204.848877:0:8507:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8507:1876213957165184:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297204.849336:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297204.849402:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062600/0x8ad177e823a0b252 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b24b expref: 20 pid: 5835 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.849434:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297204.849670:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957165824:12345-0@lo:103:ldlm_bl.0 Request processed in 5549us (5711us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297204.849680:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1789297204.849734:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020672 00000100:00100000:0.0:1789297204.849742:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020672 00010000:00010000:0.0:1789297204.849773:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 10 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297204.849793:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1789297204.849801:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:3302:x1876213957165952:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789297204.849813:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297204.849819:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00030200/0x8ad177e823a0b1f0 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 18 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297204.850210:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957165824:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297204.850327:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:3304:x1876213957165696:12345-0@lo:103:ldlm_bl.0 Request processed in 6219us (6423us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297204.850335:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789297204.850354:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:2.0:1789297204.850373:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2354:x1876213933020672:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297204.850382:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297204.850387:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 10 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297204.850400:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 10 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297204.850413:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00030a00/0x8ad177e823a0b3da lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d80b expref: 10 pid: 5837 timeout: 316 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297204.850425:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297204.850512:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b00030200/0x8ad177e823a0b1f0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 17 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850522:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00030200/0x8ad177e823a0b1f0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b1e9 expref: 17 pid: 5837 timeout: 366 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850533:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850542:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297204.850629:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957165696:0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1789297204.850683:0:5827:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850700:0:5827:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850733:0:5827:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850739:0:5827:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850745:0:5827:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297204.850750:0:5827:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850758:0:5827:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850769:0:5827:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297204.850779:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297204.851049:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:2354:x1876213933020672:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 677us (2374us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297204.851058:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789297204.851195:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:3302:x1876213957165952:12345-0@lo:103:ldlm_bl.0 Request processed in 1395us (7180us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297204.851202:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789297204.851256:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957165952:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789297204.853873:0:8507:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.853916:0:8507:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.853953:0:8507:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297204.853959:0:8507:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152b600/0x8ad177e823a0b47b lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8507 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297205.230104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297205.230145:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297205.230179:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297205.230320:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297205.231127:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020928 00000100:00100000:0.0:1789297205.231138:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020928 00000100:00100000:0.0:1789297205.231216:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789297205.231227:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933020928:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297205.231309:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933020928:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 83us (1162us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297205.231333:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00080000:0.0:1789297205.231357:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297205.231362:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933020800 00000100:00100000:3.0:1789297205.231367:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933020800 00000100:00100000:3.0:1789297205.231394:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 171 00000100:00100000:3.0:1789297205.231400:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:2353:x1876213933020800:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297205.231425:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:2353:x1876213933020800:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (1331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297205.231431:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 171 00000100:00100000:1.0:1789297205.236806:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021184 00000100:00100000:1.0:1789297205.236822:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021184 00000100:00100000:1.0:1789297205.236911:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021056 00000100:00100000:1.0:1789297205.236916:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021056 00000100:00100000:3.0:1789297205.237000:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789297205.237014:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933021184:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297205.237108:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933021184:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 97us (6926us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297205.237115:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789297205.237132:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:3.0:1789297205.237138:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933021056:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297205.237160:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933021056:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 22us (6841us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297205.237166:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00080000:3.0:1789297205.237204:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297205.237217:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789297205.695023:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789297206.080227:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789297206.080235:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a01db8800 from 4 10000000:01000000:0.0:1789297206.080240:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789297206.080281:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.080294:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.080306:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297206.080330:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166080:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.080386:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.080426:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b08166600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.080447:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166080 00000100:00100000:0.0:1789297206.080454:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166080 00000100:00100000:0.0:1789297206.080493:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789297206.080501:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957166080:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297206.080513:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297206.080524:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b482 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.080546:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.080566:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 17 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.080575:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba200, rc 0) 00000100:00100000:0.0:1789297206.080607:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957166080:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 106us (220us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.080614:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1789297206.080655:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166080:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297206.080668:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.080676:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297206.080752:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.080772:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.081197:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b08166600 going to sleep for 11 seconds 00000100:00100000:3.0:1789297206.083351:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166208 00000100:00100000:3.0:1789297206.083362:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166208 00000100:00100000:3.0:1789297206.083414:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:3.0:1789297206.083424:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957166208:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297206.083981:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957166208:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 556us (3205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297206.083989:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:2.0:1789297206.085985:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166208:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297206.086057:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297206.086839:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297206.086882:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b053046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.086942:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166336 00000100:00100000:0.0:1789297206.086949:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166336 00000100:00100000:0.0:1789297206.086997:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 174 00000100:00100000:0.0:1789297206.087007:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957166336:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.087275:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957166336:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.087280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 174 00000100:00100000:2.0:1789297206.087339:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166336:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297206.090368:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8575:1876213957166464:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297206.090454:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297206.090522:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d6c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297206.090599:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166464 00000100:00100000:2.0:1789297206.090610:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166464 00000100:00100000:2.0:1789297206.090683:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:2.0:1789297206.090692:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8575:x1876213957166464:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297206.091045:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8575:x1876213957166464:12345-0@lo:502:llog_process_th.0 Request processed in 353us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297206.091052:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1789297206.091108:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8575:1876213957166464:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297206.091216:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297206.091225:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297206.091228:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789297206.091235:0:8575:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982a01db8800 00000020:00000080:0.0:1789297206.091237:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789297206.091317:0:8575:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8575:1876213957166592:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297206.091352:0:8575:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.091375:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166592 00000100:00100000:0.0:1789297206.091378:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166592 00000100:00100000:0.0:1789297206.091401:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789297206.091406:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8575:x1876213957166592:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297206.091510:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:8575:x1876213957166592:12345-0@lo:502:llog_process_th.0 Request processed in 102us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.091516:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1789297206.091547:0:8575:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05beee40 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.091558:0:8575:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8575:1876213957166592:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297206.091576:0:8575:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297206.091580:0:8575:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297206.091581:0:8575:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789297206.091585:0:8575:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789297206.091760:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789297206.091776:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789297206.091848:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.091861:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297206.091881:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789297206.091884:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b121d2000 from 4 10000000:01000000:0.0:1789297206.091887:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789297206.091908:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.091916:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.091926:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297206.091940:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166720:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.091968:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.091987:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.091999:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166720 00000100:00100000:0.0:1789297206.092002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166720 00000100:00100000:0.0:1789297206.092019:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789297206.092025:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957166720:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297206.092033:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297206.092045:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b490 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.092074:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.092084:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.092103:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bba00, rc 0) 00000100:00100000:0.0:1789297206.092204:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957166720:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 178us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.092210:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1789297206.092239:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166720:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297206.092251:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.092260:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297206.092300:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.092324:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.092336:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.092347:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166848 00000100:00100000:0.0:1789297206.092350:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166848 00000100:00100000:0.0:1789297206.092366:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789297206.092371:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957166848:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.092567:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957166848:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 194us (241us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.092574:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1789297206.092601:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166848:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.092624:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.092655:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.092673:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399eda80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.092685:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957166976 00000100:00100000:0.0:1789297206.092688:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957166976 00000100:00100000:0.0:1789297206.092726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789297206.092732:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957166976:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.092919:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957166976:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 186us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.092925:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 179 00000100:00100000:0.0:1789297206.092960:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957166976:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297206.094190:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8576:1876213957167104:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297206.094239:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297206.094277:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.094743:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957167104 00000100:00100000:0.0:1789297206.094749:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957167104 00000100:00100000:0.0:1789297206.094864:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1789297206.094874:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8576:x1876213957167104:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297206.095074:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8576:x1876213957167104:12345-0@lo:502:llog_process_th.0 Request processed in 201us (833us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.095082:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1789297206.095098:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8576:1876213957167104:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789297206.095123:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789297206.095132:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297206.095135:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789297206.095140:0:8576:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b121d2000 00000020:00000080:1.0:1789297206.095142:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789297206.095210:0:8576:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8576:1876213957167232:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297206.095242:0:8576:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297206.095264:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957167232 00000100:00100000:1.0:1789297206.095268:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957167232 00000100:00100000:1.0:1789297206.095292:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789297206.095299:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8576:x1876213957167232:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297206.095402:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:8576:x1876213957167232:12345-0@lo:502:llog_process_th.0 Request processed in 104us (160us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297206.095410:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1789297206.095512:0:8576:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297206.095525:0:8576:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8576:1876213957167232:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789297206.095540:0:8576:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297206.095544:0:8576:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297206.095546:0:8576:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1789297206.095549:0:8576:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1789297206.095737:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1789297206.095752:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789297206.095762:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.095773:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297206.095849:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789297206.095852:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b07359800 from 4 10000000:01000000:0.0:1789297206.095855:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789297206.095878:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.095892:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.095902:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297206.095914:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957167360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.095940:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.095959:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399ed600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.095971:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957167360 00000100:00100000:0.0:1789297206.095974:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957167360 00000100:00100000:0.0:1789297206.095997:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789297206.096004:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957167360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297206.096013:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297206.096024:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b49e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.096042:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.096052:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 19 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.096069:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb200, rc 0) 00000100:00100000:0.0:1789297206.096097:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957167360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 93us (155us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.096103:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1789297206.096212:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957167360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297206.096223:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.096232:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297206.096273:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957167488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.096295:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.096308:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399ed600 going to sleep for 11 seconds 00000100:00100000:1.0:1789297206.098049:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957167488 00000100:00100000:1.0:1789297206.098069:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957167488 00000100:00100000:1.0:1789297206.098113:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789297206.098124:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957167488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297206.098384:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957167488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 263us (2088us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297206.098397:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:1.0:1789297206.099051:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957167488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297206.099106:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957167616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297206.099225:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.099253:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957167616 00000100:00100000:1.0:1789297206.099256:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969900 going to sleep for 11 seconds 00000100:00100000:0.0:1789297206.099259:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957167616 00000100:00100000:0.0:1789297206.099291:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789297206.099298:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957167616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.099442:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957167616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 143us (290us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.099449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 184 00000100:00100000:0.0:1789297206.099492:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957167616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.099660:0:8579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8579:1876213957167744:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297206.099691:0:8579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.099730:0:8579:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399ed480 going to sleep for 11 seconds 00000100:00100000:2.0:1789297206.099738:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957167744 00000100:00100000:2.0:1789297206.099743:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957167744 00000100:00100000:2.0:1789297206.099774:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:2.0:1789297206.099782:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:8579:x1876213957167744:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297206.099902:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:8579:x1876213957167744:12345-0@lo:502:llog_process_th.0 Request processed in 121us (210us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297206.099908:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1789297206.100277:0:8579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8579:1876213957167744:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297206.100299:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297206.100309:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297206.100312:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789297206.100320:0:8579:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b07359800 00000020:00000080:0.0:1789297206.100326:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1789297206.100647:0:8579:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8579:1876213957167872:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1789297206.100693:0:8579:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297206.100737:0:8579:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399ed480 going to sleep for 11 seconds 00000100:00100000:1.0:1789297206.101023:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957167872 00000100:00100000:1.0:1789297206.101028:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957167872 00000100:00100000:1.0:1789297206.101070:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1789297206.101078:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:8579:x1876213957167872:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297206.101225:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:8579:x1876213957167872:12345-0@lo:502:llog_process_th.0 Request processed in 147us (530us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297206.101232:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1789297206.101756:0:8579:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:8579:1876213957167872:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297206.101858:0:8579:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297206.101865:0:8579:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297206.101867:0:8579:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1789297206.101873:0:8579:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:2.0:1789297206.102071:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:2.0:1789297206.102087:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789297206.102097:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297206.102107:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297206.253652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297206.253774:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021312 00000100:00100000:0.0:1789297206.253794:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021312 00000100:00100000:0.0:1789297206.253852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:0.0:1789297206.253862:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:5598:x1876213933021312:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297206.253880:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297206.253898:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d84a expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.253931:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.253943:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297206.253952:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba600, rc 0) 00000100:00100000:0.0:1789297206.254014:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933021312:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 152us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.254021:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:2.0:1789297206.258625:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297206.258791:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021440 00000100:00100000:3.0:1789297206.258803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021440 00000100:00100000:3.0:1789297206.258858:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:3.0:1789297206.258869:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933021440:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297206.259159:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933021440:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 291us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297206.259168:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:3.0:1789297206.261619:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297206.261745:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021568 00000100:00100000:0.0:1789297206.261765:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021568 00000100:00100000:0.0:1789297206.261828:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:0.0:1789297206.261838:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933021568:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297206.262049:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:5598:x1876213933021568:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 212us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.262067:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:0.0:1789297206.267811:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297206.268180:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021696 00000100:00100000:2.0:1789297206.268193:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021696 00000100:00100000:2.0:1789297206.268246:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:2.0:1789297206.268257:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:6145:x1876213933021696:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789297206.268477:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:6145:x1876213933021696:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 222us (676us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297206.268490:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:2.0:1789297206.277333:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297206.279626:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021824 00000100:00100000:0.0:1789297206.279643:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021824 00000100:00100000:0.0:1789297206.279748:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:0.0:1789297206.279760:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:6145:x1876213933021824:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297206.280030:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:6145:x1876213933021824:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 271us (2706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297206.280039:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 191 00010000:00010000:1.0:1789297206.717555:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297207.229111:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957168128:0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.229227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297207.229302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957168640:0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.229332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297207.229363:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297207.229369:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957168256:0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.229390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297207.229425:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168128 00000100:00100000:0.0:1789297207.229433:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168128 00000100:00100000:0.0:1789297207.229475:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168256 00000100:00100000:0.0:1789297207.229478:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168256 00000100:00100000:0.0:1789297207.229507:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789297207.229523:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957168128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.229577:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957168128:12345-0@lo:400:kworker.0 Request processed in 55us (351us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297207.229584:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789297207.229601:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789297207.229607:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957168256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.229634:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957168256:12345-0@lo:400:kworker.0 Request processed in 27us (243us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297207.229640:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789297207.229658:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168640 00000100:00100000:0.0:1789297207.229661:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168640 00000100:00100000:0.0:1789297207.229688:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789297207.229694:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957168640:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.229757:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957168640:12345-0@lo:400:kworker.0 Request processed in 63us (424us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297207.229764:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00080000:0.0:1789297207.229785:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789297207.229789:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297207.229820:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957168256:0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.229830:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957168128:0@lo:400:kworker.0 00010000:00080000:0.0:1789297207.229841:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b385a2680 x1876213957168640/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297207.229852:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957168640:0@lo:400:kworker.0 00000100:00100000:2.0:1789297207.230013:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957168000:0@lo:400:kworker.0 00000100:00100000:2.0:1789297207.230047:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297207.230096:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957168512:0@lo:400:kworker.0 00000100:00100000:2.0:1789297207.230135:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297207.230157:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789297207.230163:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957168384:0@lo:400:kworker.0 00000100:00100000:2.0:1789297207.230183:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297207.230209:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168384 00000100:00100000:2.0:1789297207.230212:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168384 00000100:00100000:2.0:1789297207.230243:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789297207.230250:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957168384:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297207.230284:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957168384:12345-0@lo:400:kworker.0 Request processed in 35us (99us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297207.230290:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:2.0:1789297207.230305:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1789297207.230323:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b385a3480 x1876213957168384/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297223 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297207.230332:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957168384:0@lo:400:kworker.0 00000100:00100000:2.0:1789297207.230348:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168512 00000100:00100000:2.0:1789297207.230351:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168512 00000100:00100000:2.0:1789297207.230380:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789297207.230387:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957168512:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297207.230418:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957168512:12345-0@lo:400:kworker.0 Request processed in 31us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297207.230430:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1789297207.230447:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297207.230462:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957168512:0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.230817:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168000 00000100:00100000:0.0:1789297207.230822:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168000 00000100:00100000:0.0:1789297207.230867:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:0.0:1789297207.230874:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957168000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297207.230911:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957168000:12345-0@lo:400:kworker.0 Request processed in 37us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297207.230917:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:2.0:1789297207.231229:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957168000:0@lo:400:kworker.0 00010000:00010000:0.0:1789297207.740989:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297207.743747:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957168768:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297207.743822:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297207.744005:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168768 00000100:00100000:3.0:1789297207.744013:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168768 00000100:00100000:3.0:1789297207.744084:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:3.0:1789297207.744094:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957168768:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297207.744128:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297207.748746:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957168768:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4644us (4915us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297207.748760:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1789297207.755205:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef6d80 x1876213957168768/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297207.755232:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957168768:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297208.256023:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297208.256057:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957168896:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297208.256139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297208.256236:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957168896 00000100:00100000:3.0:1789297208.256245:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957168896 00000100:00100000:3.0:1789297208.256312:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789297208.256321:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957168896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297208.256355:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297208.256404:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957168896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 84us (265us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297208.256412:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00080000:3.0:1789297208.256452:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ee7b80 x1876213957168896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297208.256470:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957168896:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789297208.765032:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297209.789083:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297210.349796:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297210.349832:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297210.349856:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297210.349876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297210.349903:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022208 00000100:00100000:2.0:1789297210.349915:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022208 00000100:00100000:2.0:1789297210.349976:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022336 00000100:00100000:2.0:1789297210.349978:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022336 00000100:00100000:2.0:1789297210.349994:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:2.0:1789297210.350004:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2355:x1876213933022208:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297210.350083:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2355:x1876213933022208:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 81us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297210.350091:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:2.0:1789297210.350105:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789297210.350110:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2355:x1876213933022336:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297210.350130:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2355:x1876213933022336:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 20us (253us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297210.350136:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789297210.350149:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022080 00000100:00100000:2.0:1789297210.350152:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022080 00000100:00100000:2.0:1789297210.350175:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:2.0:1789297210.350188:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933022080:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297210.350213:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933022080:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297210.350219:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00080000:2.0:1789297210.350236:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789297210.350240:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297210.350242:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297210.350487:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933021952 00000100:00100000:1.0:1789297210.350492:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933021952 00000100:00100000:1.0:1789297210.350523:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:1.0:1789297210.350530:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933021952:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297210.350564:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933021952:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 35us (779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297210.350571:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 193 00010000:00010000:0.0:1789297210.812821:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789297210.883192:0:8807:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing check_logdir /tmp/testlogs/ 00010000:00010000:0.0:1789297211.841463:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297212.350020:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957169024:0@lo:400:kworker.0 00000100:00100000:1.0:1789297212.350104:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297212.356075:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297212.356101:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957169408:0@lo:400:kworker.0 00000100:00100000:1.0:1789297212.356184:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297212.356325:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169408 00000100:00100000:1.0:1789297212.356333:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169408 00000100:00100000:1.0:1789297212.356391:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1789297212.356407:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957169408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297212.356467:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957169408:12345-0@lo:400:kworker.0 Request processed in 66us (282us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297212.356474:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:1.0:1789297212.357038:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1789297212.357079:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ee7800 x1876213957169408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297212.357096:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957169408:0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.357351:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169024 00000100:00100000:3.0:1789297212.357357:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169024 00000100:00100000:3.0:1789297212.357399:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789297212.357407:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957169024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.357452:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957169024:12345-0@lo:400:kworker.0 Request processed in 46us (7348us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297212.357458:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:3.0:1789297212.357487:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789297212.357497:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957169536:0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.357529:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297212.357562:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957169152:0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.357605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297212.357627:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957169664:0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.357650:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297212.357671:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297212.357685:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957169280:0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.357725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297212.357762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169536 00000100:00100000:3.0:1789297212.357766:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169536 00000100:00100000:3.0:1789297212.357800:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169152 00000100:00100000:3.0:1789297212.357804:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169152 00000100:00100000:3.0:1789297212.357815:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169280 00000100:00100000:3.0:1789297212.357817:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169280 00000100:00100000:3.0:1789297212.357832:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789297212.357838:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957169536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297212.359419:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957169024:0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.360740:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957169536:12345-0@lo:400:kworker.0 Request processed in 2892us (3200us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297212.360755:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:3.0:1789297212.360790:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789297212.360802:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957169152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297212.361045:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957169536:0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.361307:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957169152:12345-0@lo:400:kworker.0 Request processed in 509us (3701us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297212.361314:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1789297212.361329:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789297212.361338:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957169280:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.361373:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957169280:12345-0@lo:400:kworker.0 Request processed in 38us (3647us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297212.361379:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789297212.361405:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169664 00000100:00100000:3.0:1789297212.361412:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169664 00000100:00100000:3.0:1789297212.361452:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789297212.361459:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957169664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297212.361508:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c85c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957169664:12345-0@lo:400:kworker.0 Request processed in 50us (3856us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297212.361514:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:3.0:1789297212.361544:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297212.361549:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297212.362858:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957169280:0@lo:400:kworker.0 00000100:00100000:1.0:1789297212.363074:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957169152:0@lo:400:kworker.0 00010000:00080000:1.0:1789297212.363104:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41e17800 x1876213957169664/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297228 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297212.363116:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e17800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957169664:0@lo:400:kworker.0 00000100:00100000:1.0:1789297212.863208:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297212.863237:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957169792:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297212.863331:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297212.863433:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169792 00000100:00100000:1.0:1789297212.863444:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169792 00000100:00100000:1.0:1789297212.863503:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789297212.863514:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957169792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297212.863552:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297212.863601:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957169792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297212.863609:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:1.0:1789297212.863657:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39ca0000 x1876213957169792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297228 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297212.863677:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957169792:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789297212.864336:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297213.373043:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957169920:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297213.373134:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297213.373819:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957169920 00000100:00100000:3.0:1789297213.373830:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957169920 00000100:00100000:3.0:1789297213.373895:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1789297213.373905:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957169920:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297213.373945:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297213.374018:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957169920:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (884us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297213.374027:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:0.0:1789297213.374333:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39c85f80 x1876213957169920/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297213.374354:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957169920:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789297213.884886:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297214.915127:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297215.472651:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297215.472699:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297215.472752:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022464 00000100:00100000:1.0:1789297215.472763:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022464 00000100:00100000:1.0:1789297215.472822:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 195 00000100:00100000:1.0:1789297215.472836:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933022464:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297215.472934:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933022464:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 101us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297215.472942:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 195 00000100:00100000:1.0:1789297215.472985:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022592 00000100:00100000:1.0:1789297215.472989:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022592 00000100:00100000:1.0:1789297215.473026:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:1.0:1789297215.473033:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933022592:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297215.473062:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933022592:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 30us (363us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297215.473068:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00080000:1.0:1789297215.473198:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297215.478536:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297215.478572:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297215.478605:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022720 00000100:00100000:2.0:1789297215.478615:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022720 00000100:00100000:2.0:1789297215.478684:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022848 00000100:00100000:2.0:1789297215.478687:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022848 00000100:00100000:2.0:1789297215.478730:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297215.478740:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2352:x1876213933022720:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:2.0:1789297215.478785:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b3e8 00000100:00080000:2.0:1789297215.478796:0:6688:0:(import.c:65:import_set_state_nolock()) ffff982b27c31800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789297215.478836:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789297215.481401:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+2:2352:x1876213933022720:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 2650us (2865us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297215.481417:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297215.481448:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789297215.481459:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2352:x1876213933022848:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:2.0:1789297215.481487:0:6688:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b3ef 00000100:00080000:2.0:1789297215.481498:0:6688:0:(import.c:65:import_set_state_nolock()) ffff982b27c35000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789297215.481529:0:6688:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:2.0:1789297215.481756:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+2:2352:x1876213933022848:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 299us (3181us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297215.481763:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00080000:2.0:1789297215.481787:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297215.481791:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789297215.481859:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297215.482117:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297215.933487:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789297216.491647:0:9051:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing yml_node 00010000:00010000:3.0:1789297216.957245:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297217.469076:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957170048:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469163:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297217.469215:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957170560:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469243:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297217.469272:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297217.469278:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957170432:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469303:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297217.469334:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957170176:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469356:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297217.469373:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957170688:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469392:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297217.469422:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297217.469428:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957170304:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297217.469497:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170432 00000100:00100000:1.0:1789297217.469504:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170432 00000100:00100000:1.0:1789297217.469574:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170688 00000100:00100000:1.0:1789297217.469577:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170688 00000100:00100000:1.0:1789297217.469596:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789297217.469604:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957170432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469651:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957170432:12345-0@lo:400:kworker.0 Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297217.469658:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789297217.469672:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789297217.469678:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957170688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469729:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957170688:12345-0@lo:400:kworker.0 Request processed in 27us (310us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297217.469735:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789297217.469755:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170560 00000100:00100000:1.0:1789297217.469758:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170560 00000100:00100000:1.0:1789297217.469779:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170176 00000100:00100000:1.0:1789297217.469782:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170176 00000100:00100000:1.0:1789297217.469793:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170304 00000100:00100000:1.0:1789297217.469795:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170304 00000100:00100000:1.0:1789297217.469811:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789297217.469818:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957170560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.469847:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957170560:12345-0@lo:400:kworker.0 Request processed in 30us (603us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297217.469854:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789297217.469865:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789297217.469871:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957170176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.470151:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957170176:12345-0@lo:400:kworker.0 Request processed in 280us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297217.470158:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1789297217.470171:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789297217.470178:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957170304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.470205:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957170304:12345-0@lo:400:kworker.0 Request processed in 28us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297217.470210:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1789297217.470228:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789297217.470233:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789297217.470235:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297217.470270:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957170304:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.470282:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957170176:0@lo:400:kworker.0 00010000:00080000:1.0:1789297217.470293:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39ca2d80 x1876213957170688/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297217.470304:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957170688:0@lo:400:kworker.0 00010000:00080000:1.0:1789297217.470335:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39ca3100 x1876213957170432/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297233 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297217.470343:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957170432:0@lo:400:kworker.0 00000100:00100000:1.0:1789297217.470352:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957170560:0@lo:400:kworker.0 00000100:00100000:3.0:1789297217.470458:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170048 00000100:00100000:3.0:1789297217.470463:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170048 00000100:00100000:3.0:1789297217.470498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789297217.470506:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957170048:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297217.470546:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957170048:12345-0@lo:400:kworker.0 Request processed in 41us (1384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297217.470615:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1789297217.471032:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957170048:0@lo:400:kworker.0 00000001:00100000:3.0:1789297217.581808:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:3.0:1789297217.581818:0:6712:0:(genops.c:885:class_export_put()) final put ffff982b27c32800/235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:3.0:1789297217.581853:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c32800/235dd3df-f928-4719-bb69-fc817cc2744f for lustre-OST0000 00000020:00000080:3.0:1789297217.581909:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b27c31800 for lustre-OST0000 00010000:00010000:0.0:1789297217.980912:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297217.981466:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957170816:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297217.981540:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297217.984200:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170816 00000100:00100000:3.0:1789297217.984214:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170816 00000100:00100000:3.0:1789297217.984337:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1789297217.984348:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957170816:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297217.984386:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297217.984482:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957170816:12345-0@lo:13:osp-pre-1-0.0 Request processed in 136us (2941us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297217.984488:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00010000:00080000:2.0:1789297217.985217:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ee4000 x1876213957170816/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297233 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297217.985253:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957170816:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297218.493033:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297218.493057:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957170944:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297218.493132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297218.493370:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957170944 00000100:00100000:2.0:1789297218.493379:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957170944 00000100:00100000:2.0:1789297218.493448:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789297218.493458:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957170944:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789297218.493494:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297218.493546:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c87800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957170944:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (416us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297218.493553:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00010000:00080000:1.0:1789297218.494389:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096f480 x1876213957170944/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297218.494414:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957170944:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789297219.005089:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789297219.571288:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:3.0:1789297219.571298:0:7644:0:(genops.c:885:class_export_put()) final put ffff982b27c32000/235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:0.0:1789297219.571398:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c32000/235dd3df-f928-4719-bb69-fc817cc2744f for lustre-OST0001 00000020:00000080:0.0:1789297219.571531:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b27c35000 for lustre-OST0001 00010000:00010000:2.0:1789297220.028983:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297220.591076:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297220.591123:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297220.591155:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933023104 00000100:00100000:1.0:1789297220.591165:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933023104 00000100:00100000:1.0:1789297220.591234:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:1.0:1789297220.591245:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933023104:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297220.591315:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933023104:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 72us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297220.591323:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00080000:1.0:1789297220.591344:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297220.591619:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933022976 00000100:00100000:3.0:1789297220.591624:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933022976 00000100:00100000:3.0:1789297220.591659:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 197 00000100:00100000:3.0:1789297220.591667:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2353:x1876213933022976:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297220.591699:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2353:x1876213933022976:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 33us (633us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297220.591733:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 197 00000001:02000400:3.0:1789297220.684634:0:9244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.108 00010000:00010000:0.0:1789297221.053047:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297222.077193:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297222.588979:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957171200:0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.589055:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297222.589108:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957171712:0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.589134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297222.589300:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957171456:0@lo:400:kworker.0 00000100:00100000:0.0:1789297222.589333:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297222.589421:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957171072:0@lo:400:kworker.0 00000100:00100000:2.0:1789297222.589454:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297222.589614:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297222.589622:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957171328:0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.589657:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297222.589686:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171712 00000100:00100000:1.0:1789297222.589695:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171712 00000100:00100000:1.0:1789297222.589767:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171456 00000100:00100000:1.0:1789297222.589770:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171456 00000100:00100000:1.0:1789297222.589789:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789297222.589797:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957171712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.589852:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957171712:12345-0@lo:400:kworker.0 Request processed in 55us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297222.589859:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789297222.589885:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297222.589892:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957171456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.589933:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957171456:12345-0@lo:400:kworker.0 Request processed in 42us (599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297222.589940:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297222.589962:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171072 00000100:00100000:1.0:1789297222.589966:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171072 00000100:00100000:1.0:1789297222.589994:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1789297222.590001:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957171072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.590035:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957171072:12345-0@lo:400:kworker.0 Request processed in 35us (580us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297222.590041:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00080000:1.0:1789297222.590068:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789297222.590072:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789297222.590266:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171200 00000100:00100000:3.0:1789297222.590272:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171200 00000100:00100000:3.0:1789297222.590305:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171328 00000100:00100000:3.0:1789297222.590315:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171328 00000100:00100000:3.0:1789297222.590347:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789297222.590354:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957171200:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297222.590395:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957171200:12345-0@lo:400:kworker.0 Request processed in 42us (1340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297222.590402:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789297222.590414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789297222.590420:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957171328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297222.590447:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957171328:12345-0@lo:400:kworker.0 Request processed in 26us (789us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297222.590453:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00080000:3.0:1789297222.590476:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297222.591445:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957171072:0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.591462:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957171584:0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.591518:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297222.592547:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171584 00000100:00100000:3.0:1789297222.592557:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171584 00000100:00100000:3.0:1789297222.592623:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789297222.592631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957171584:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297222.593122:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957171584:12345-0@lo:400:kworker.0 Request processed in 490us (1602us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297222.593131:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:3.0:1789297222.593228:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297222.593372:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957171328:0@lo:400:kworker.0 00000100:00100000:3.0:1789297222.593387:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957171200:0@lo:400:kworker.0 00010000:00080000:3.0:1789297222.593403:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39ca2d80 x1876213957171712/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297222.593413:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957171712:0@lo:400:kworker.0 00010000:00080000:0.0:1789297222.596765:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39ca1c00 x1876213957171456/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297238 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297222.596784:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957171456:0@lo:400:kworker.0 00000100:00100000:1.0:1789297222.597099:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957171584:0@lo:400:kworker.0 00010000:00010000:2.0:1789297223.102087:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297223.102259:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957171840:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297223.102336:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297223.102515:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171840 00000100:00100000:2.0:1789297223.102524:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171840 00000100:00100000:2.0:1789297223.102579:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789297223.102590:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957171840:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789297223.102641:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297223.102721:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957171840:12345-0@lo:13:osp-pre-1-0.0 Request processed in 112us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297223.102730:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:0.0:1789297223.102878:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b0700 x1876213957171840/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297223.102898:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957171840:0@lo:13:osp-pre-1-0.0 00000001:02000400:3.0:1789297223.310081:0:9343:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.108 00000100:00100000:2.0:1789297223.619028:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957171968:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297223.619105:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297223.623156:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957171968 00000100:00100000:1.0:1789297223.623175:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957171968 00000100:00100000:1.0:1789297223.623251:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789297223.623263:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957171968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297223.623313:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297223.632143:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957171968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 8872us (13026us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297223.632157:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:2.0:1789297223.632342:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096d180 x1876213957171968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297223.632367:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957171968:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789297224.126041:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297225.158996:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297225.710128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297225.710184:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297225.710386:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933023360 00000100:00100000:0.0:1789297225.710398:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933023360 00000100:00100000:0.0:1789297225.710498:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:0.0:1789297225.710509:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933023360:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297225.710615:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933023360:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 108us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297225.710623:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00080000:2.0:1789297225.711188:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297225.711307:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933023232 00000100:00100000:3.0:1789297225.711316:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933023232 00000100:00100000:3.0:1789297225.711370:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 199 00000100:00100000:3.0:1789297225.711378:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2353:x1876213933023232:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297225.711434:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2353:x1876213933023232:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 56us (1317us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297225.711441:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 199 00000001:02000400:1.0:1789297225.948509:0:9440:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.108 00010000:00010000:2.0:1789297226.173002:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297227.197074:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297227.709473:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957172480:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.709551:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297227.709612:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789297227.709619:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957172096:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.709646:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297227.709669:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957172608:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.709693:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297227.709741:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957172224:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.709764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297227.709781:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957172736:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.709800:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297227.709817:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297227.709822:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957172352:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.709842:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297227.709887:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172480 00000100:00100000:3.0:1789297227.709903:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172480 00000100:00100000:3.0:1789297227.709973:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172736 00000100:00100000:3.0:1789297227.709977:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172736 00000100:00100000:3.0:1789297227.709999:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789297227.710007:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957172480:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710062:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957172480:12345-0@lo:400:kworker.0 Request processed in 55us (511us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297227.710069:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789297227.710086:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789297227.710092:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957172736:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710124:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957172736:12345-0@lo:400:kworker.0 Request processed in 32us (322us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297227.710130:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789297227.710146:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172096 00000100:00100000:3.0:1789297227.710150:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172096 00000100:00100000:3.0:1789297227.710185:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789297227.710191:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957172096:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710219:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957172096:12345-0@lo:400:kworker.0 Request processed in 28us (572us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297227.710224:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:3.0:1789297227.710250:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172608 00000100:00100000:3.0:1789297227.710254:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172608 00000100:00100000:3.0:1789297227.710278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172224 00000100:00100000:3.0:1789297227.710281:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172224 00000100:00100000:3.0:1789297227.710291:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172352 00000100:00100000:3.0:1789297227.710293:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172352 00000100:00100000:3.0:1789297227.710305:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789297227.710310:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957172608:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710352:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957172608:12345-0@lo:400:kworker.0 Request processed in 41us (657us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297227.710358:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789297227.710370:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789297227.710377:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957172224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710403:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957172224:12345-0@lo:400:kworker.0 Request processed in 26us (637us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297227.710409:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789297227.710419:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1789297227.710425:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957172352:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710450:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957172352:12345-0@lo:400:kworker.0 Request processed in 26us (607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297227.710455:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:3.0:1789297227.710481:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789297227.710485:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297227.710488:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297227.710527:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957172352:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710538:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957172224:0@lo:400:kworker.0 00010000:00080000:3.0:1789297227.710550:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39c87480 x1876213957172736/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297227.710560:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957172736:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710589:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c84e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957172096:0@lo:400:kworker.0 00000100:00100000:3.0:1789297227.710600:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c85880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957172608:0@lo:400:kworker.0 00010000:00080000:3.0:1789297227.710621:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39c86300 x1876213957172480/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297243 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297227.710629:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c86300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957172480:0@lo:400:kworker.0 00000001:02000400:2.0:1789297227.721139:0:9488:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Sun Sep 13 07:00:26 EDT 2026 00000100:00100000:2.0:1789297228.222002:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297228.222030:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957172864:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297228.222104:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297228.222418:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172864 00000100:00100000:1.0:1789297228.222427:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172864 00000100:00100000:1.0:1789297228.222484:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789297228.222494:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957172864:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297228.222527:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297228.222576:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957172864:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (471us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297228.222583:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:2.0:1789297228.222668:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b0380 x1876213957172864/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297228.222689:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957172864:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789297228.222794:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297228.739887:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957172992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297228.739959:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297228.740063:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957172992 00000100:00100000:0.0:1789297228.740072:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957172992 00000100:00100000:0.0:1789297228.740121:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789297228.740131:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957172992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297228.740168:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297228.742960:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957172992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 2820us (2989us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297228.742976:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:1.0:1789297228.745071:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096ea00 x1876213957172992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297228.745100:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096ea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957172992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789297229.245486:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297230.271501:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297230.831034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297230.831251:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297230.831329:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933023488 00000100:00100000:0.0:1789297230.831345:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933023488 00000100:00100000:0.0:1789297230.831414:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:0.0:1789297230.831426:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933023488:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297230.831536:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933023488:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 112us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297230.831546:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:3.0:1789297230.833383:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933023616 00000100:00100000:3.0:1789297230.833403:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933023616 00000100:00100000:3.0:1789297230.833494:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:3.0:1789297230.833505:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2356:x1876213933023616:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297230.833612:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40942d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2356:x1876213933023616:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 109us (2594us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297230.833619:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00080000:2.0:1789297230.835364:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789297231.292896:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297232.317078:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297232.829861:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957173504:0@lo:400:kworker.0 00000100:00100000:2.0:1789297232.829984:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297232.830086:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789297232.830093:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957173120:0@lo:400:kworker.0 00000100:00100000:2.0:1789297232.830146:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297232.830171:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957173632:0@lo:400:kworker.0 00000100:00100000:2.0:1789297232.830201:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297232.830552:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957173504 00000100:00100000:1.0:1789297232.830573:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957173504 00000100:00100000:1.0:1789297232.830655:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1789297232.830675:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957173504:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297232.831013:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957173504:12345-0@lo:400:kworker.0 Request processed in 346us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297232.831022:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789297232.831144:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957173120 00000100:00100000:3.0:1789297232.831150:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957173120 00000100:00100000:3.0:1789297232.831202:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789297232.831211:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957173120:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297232.831253:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957173120:12345-0@lo:400:kworker.0 Request processed in 43us (1106us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297232.831260:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:3.0:1789297232.831299:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957173632 00000100:00100000:3.0:1789297232.831304:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957173632 00000100:00100000:3.0:1789297232.831337:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789297232.831344:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957173632:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297232.831379:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957173632:12345-0@lo:400:kworker.0 Request processed in 36us (1177us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297232.831386:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:2.0:1789297232.831760:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789297232.831767:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789297232.831821:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957173120:0@lo:400:kworker.0 00000100:00100000:2.0:1789297232.831955:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957173632:0@lo:400:kworker.0 00010000:00080000:2.0:1789297232.831976:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3b80 x1876213957173504/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297232.831987:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957173504:0@lo:400:kworker.0 00000100:00100000:0.0:1789297232.832448:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957173248:0@lo:400:kworker.0 00000100:00100000:0.0:1789297232.832534:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297232.832589:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957173760:0@lo:400:kworker.0 00000100:00100000:0.0:1789297232.832619:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297232.832640:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297232.832647:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957173376:0@lo:400:kworker.0 00000100:00100000:0.0:1789297232.832670:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297232.832806:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957173760 00000100:00100000:3.0:1789297232.832848:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957173760 00000100:00100000:3.0:1789297232.832912:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789297232.832921:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957173760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297232.832980:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957173760:12345-0@lo:400:kworker.0 Request processed in 60us (359us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297232.832988:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1789297232.836507:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297232.841090:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957173248 00000100:00100000:1.0:1789297232.841113:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957173248 00000100:00100000:1.0:1789297232.841201:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957173376 00000100:00100000:1.0:1789297232.841205:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957173376 00000100:00100000:1.0:1789297232.841252:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789297232.841265:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957173248:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297232.841415:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957173248:12345-0@lo:400:kworker.0 Request processed in 153us (8882us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297232.841423:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789297232.841441:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789297232.841447:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957173376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297232.841471:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957173376:12345-0@lo:400:kworker.0 Request processed in 26us (8801us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297232.841476:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1789297232.841502:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297232.841597:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957173376:0@lo:400:kworker.0 00000100:00100000:1.0:1789297232.841611:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957173248:0@lo:400:kworker.0 00010000:00080000:1.0:1789297232.841628:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3480 x1876213957173760/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297248 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297232.841639:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957173760:0@lo:400:kworker.0 00010000:00010000:0.0:1789297233.340886:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297233.343553:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297233.343600:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957173888:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297233.343748:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297233.344573:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957173888 00000100:00100000:1.0:1789297233.344589:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957173888 00000100:00100000:1.0:1789297233.344682:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789297233.344696:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957173888:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297233.344777:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297233.344874:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c86300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957173888:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (1126us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297233.344883:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00080000:3.0:1789297233.345152:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3480 x1876213957173888/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297233.345181:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957173888:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297233.853354:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297233.853392:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957174016:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297233.853522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297233.853817:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174016 00000100:00100000:0.0:1789297233.853829:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174016 00000100:00100000:0.0:1789297233.853898:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789297233.853908:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957174016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297233.853957:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297233.854023:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957174016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297233.854031:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:0.0:1789297233.854102:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096f100 x1876213957174016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297233.854127:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957174016:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789297234.364949:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297235.389040:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297235.953093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297235.953142:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297235.953169:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933023872 00000100:00100000:3.0:1789297235.953178:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933023872 00000100:00100000:3.0:1789297235.953244:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:3.0:1789297235.953255:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933023872:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297235.953330:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933023872:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 77us (248us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297235.953338:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:3.0:1789297235.953363:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933023744 00000100:00100000:3.0:1789297235.953367:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933023744 00000100:00100000:3.0:1789297235.953390:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:3.0:1789297235.953396:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2354:x1876213933023744:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297235.953431:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2354:x1876213933023744:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 34us (288us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297235.953437:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00080000:3.0:1789297235.953464:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789297236.413373:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297237.438051:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297237.956095:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957174144:0@lo:400:kworker.0 00000100:00100000:2.0:1789297237.956178:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297237.956236:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957174656:0@lo:400:kworker.0 00000100:00100000:2.0:1789297237.956265:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297237.956291:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789297237.956297:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957174528:0@lo:400:kworker.0 00000100:00100000:2.0:1789297237.956321:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297237.956352:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174656 00000100:00100000:2.0:1789297237.956359:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174656 00000100:00100000:2.0:1789297237.956672:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789297237.956682:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957174656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297237.956757:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957174656:12345-0@lo:400:kworker.0 Request processed in 77us (491us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297237.956774:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1789297237.956822:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957174656:0@lo:400:kworker.0 00000100:00100000:1.0:1789297237.957085:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174144 00000100:00100000:1.0:1789297237.957090:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174144 00000100:00100000:1.0:1789297237.957134:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:1.0:1789297237.957143:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957174144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297237.957184:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957174144:12345-0@lo:400:kworker.0 Request processed in 43us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297237.957191:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1789297237.957258:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957174144:0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.957399:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957174272:0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.957661:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297237.957695:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957174784:0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.957754:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297237.957788:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297237.957795:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957174400:0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.957816:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297237.957843:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174528 00000100:00100000:3.0:1789297237.957847:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174528 00000100:00100000:3.0:1789297237.957881:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174784 00000100:00100000:3.0:1789297237.957884:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174784 00000100:00100000:3.0:1789297237.957901:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789297237.957907:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957174528:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.957951:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957174528:12345-0@lo:400:kworker.0 Request processed in 43us (1628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297237.957957:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1789297237.957974:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1789297237.957980:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957174784:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.958013:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c87480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957174784:12345-0@lo:400:kworker.0 Request processed in 33us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297237.958018:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:3.0:1789297237.958047:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297237.958051:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297237.958054:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297237.958072:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174272 00000100:00100000:3.0:1789297237.958076:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174272 00000100:00100000:3.0:1789297237.958098:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174400 00000100:00100000:3.0:1789297237.958101:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174400 00000100:00100000:3.0:1789297237.958121:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789297237.958128:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957174272:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.958160:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957174272:12345-0@lo:400:kworker.0 Request processed in 33us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297237.958166:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789297237.958178:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789297237.958184:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957174400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.958211:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957174400:12345-0@lo:400:kworker.0 Request processed in 28us (394us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297237.958217:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1789297237.958250:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957174400:0@lo:400:kworker.0 00000100:00100000:3.0:1789297237.958261:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957174272:0@lo:400:kworker.0 00010000:00080000:3.0:1789297237.958272:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b0a80 x1876213957174784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297237.958283:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957174784:0@lo:400:kworker.0 00000100:00080000:3.0:1789297237.958301:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789297237.958323:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3480 x1876213957174528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297253 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297237.958334:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957174528:0@lo:400:kworker.0 00000100:00100000:3.0:1789297238.461937:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297238.461976:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957174912:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297238.462052:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297238.462238:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957174912 00000100:00100000:1.0:1789297238.462248:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957174912 00000100:00100000:1.0:1789297238.462314:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789297238.462325:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957174912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297238.462369:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297238.462423:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957174912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297238.462430:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00080000:1.0:1789297238.462472:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3800 x1876213957174912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297238.462493:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957174912:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297238.462653:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297238.972872:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789297238.972893:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957175040:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297238.972975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297238.973216:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175040 00000100:00100000:1.0:1789297238.973224:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175040 00000100:00100000:1.0:1789297238.973281:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1789297238.973291:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957175040:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297238.973327:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297238.973375:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957175040:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (400us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297238.973387:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1789297238.973426:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096f100 x1876213957175040/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297238.973444:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957175040:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789297239.485678:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297240.519784:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297241.070809:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297241.070857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297241.071093:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024000 00000100:00100000:3.0:1789297241.071104:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024000 00000100:00100000:3.0:1789297241.071157:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 205 00000100:00100000:3.0:1789297241.071169:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2353:x1876213933024000:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297241.071246:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2353:x1876213933024000:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 80us (443us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297241.071254:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 205 00000100:00100000:3.0:1789297241.071286:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024128 00000100:00100000:3.0:1789297241.071290:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024128 00000100:00100000:3.0:1789297241.071323:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:3.0:1789297241.071344:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933024128:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297241.071376:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933024128:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 46us (518us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297241.071382:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00080000:3.0:1789297241.071533:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789297241.533194:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297242.557911:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297243.069062:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957175168:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069171:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297243.069235:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957175680:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069329:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297243.069363:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789297243.069370:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957175552:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069411:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297243.069452:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957175424:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297243.069493:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:0.0:1789297243.069499:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957175296:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069520:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297243.069538:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957175808:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069556:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297243.069586:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175680 00000100:00100000:0.0:1789297243.069594:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175680 00000100:00100000:0.0:1789297243.069669:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175424 00000100:00100000:0.0:1789297243.069673:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175424 00000100:00100000:0.0:1789297243.069689:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175296 00000100:00100000:0.0:1789297243.069692:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175296 00000100:00100000:0.0:1789297243.069766:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789297243.069776:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957175680:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069853:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957175680:12345-0@lo:400:kworker.0 Request processed in 79us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297243.069861:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1789297243.069878:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789297243.069883:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957175424:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069911:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957175424:12345-0@lo:400:kworker.0 Request processed in 29us (435us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297243.069916:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789297243.069926:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789297243.069933:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957175296:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.069957:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957175296:12345-0@lo:400:kworker.0 Request processed in 25us (436us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297243.069963:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789297243.069980:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175552 00000100:00100000:0.0:1789297243.069984:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175552 00000100:00100000:0.0:1789297243.070011:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175808 00000100:00100000:0.0:1789297243.070014:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175808 00000100:00100000:0.0:1789297243.070028:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789297243.070034:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957175552:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.070065:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957175552:12345-0@lo:400:kworker.0 Request processed in 32us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297243.070071:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789297243.070081:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789297243.070086:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957175808:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.070110:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957175808:12345-0@lo:400:kworker.0 Request processed in 24us (553us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297243.070125:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00080000:0.0:1789297243.070151:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789297243.070154:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789297243.070157:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297243.070227:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957175296:0@lo:400:kworker.0 00010000:00080000:0.0:1789297243.070240:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b0000 x1876213957175808/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297243.070251:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957175808:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.070261:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957175424:0@lo:400:kworker.0 00010000:00080000:0.0:1789297243.070296:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3480 x1876213957175552/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297259 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297243.070306:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957175552:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.070315:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957175680:0@lo:400:kworker.0 00000100:00100000:1.0:1789297243.070625:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175168 00000100:00100000:1.0:1789297243.070642:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175168 00000100:00100000:1.0:1789297243.070688:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1789297243.070697:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957175168:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297243.070770:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957175168:12345-0@lo:400:kworker.0 Request processed in 75us (1599us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297243.070777:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:0.0:1789297243.072375:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957175168:0@lo:400:kworker.0 00000100:00100000:0.0:1789297243.581083:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957175936:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297243.581159:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789297243.581364:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297243.581480:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957175936 00000100:00100000:2.0:1789297243.581490:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957175936 00000100:00100000:2.0:1789297243.581549:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789297243.581559:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957175936:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789297243.581598:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297243.581665:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957175936:12345-0@lo:13:osp-pre-1-0.0 Request processed in 107us (505us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297243.581672:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:0.0:1789297243.581839:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b1f80 x1876213957175936/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297259 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297243.581858:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957175936:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297244.093336:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957176064:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297244.093754:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297244.093907:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176064 00000100:00100000:3.0:1789297244.093918:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176064 00000100:00100000:3.0:1789297244.093980:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1789297244.093993:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957176064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297244.094034:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297244.094086:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957176064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297244.094093:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00010000:00080000:0.0:1789297244.094207:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096f480 x1876213957176064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297260 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297244.094227:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957176064:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789297244.609307:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789297245.083249:0:10119:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 07:00:43 (1789297243) === 00000100:00100000:3.0:1789297245.566274:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.566495:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024256 00000100:00100000:0.0:1789297245.566507:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024256 00000100:00100000:0.0:1789297245.566577:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 207 00000100:00100000:0.0:1789297245.566588:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:8138:x1876213933024256:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789297245.566606:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297245.566624:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bac00/0x8ad177e823a0b4b3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d851 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297245.566658:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bac00/0x8ad177e823a0b4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d851 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297245.566671:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bac00/0x8ad177e823a0b4b3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d851 expref: 11 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297245.566681:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bac00, rc 0) 00000100:00100000:0.0:1789297245.566796:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8138:x1876213933024256:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 209us (537us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.566803:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 207 00000100:00100000:3.0:1789297245.572501:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.573626:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024384 00000100:00100000:0.0:1789297245.573645:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024384 00000100:00100000:0.0:1789297245.573768:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 208 00000100:00100000:0.0:1789297245.573781:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8138:x1876213933024384:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789297245.574152:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8138:x1876213933024384:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 373us (1663us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.574161:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 208 00000100:00100000:3.0:1789297245.591182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297245.591312:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024512 00000100:00100000:1.0:1789297245.591326:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024512 00000100:00100000:1.0:1789297245.591399:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 209 00000100:00100000:1.0:1789297245.591410:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8138:x1876213933024512:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789297245.591733:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8138:x1876213933024512:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 284us (521us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297245.591743:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 209 00000100:00100000:3.0:1789297245.603935:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297245.604567:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024640 00000100:00100000:1.0:1789297245.604579:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024640 00000100:00100000:1.0:1789297245.604744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 210 00000100:00100000:1.0:1789297245.604756:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8141:x1876213933024640:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789297245.605128:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8141:x1876213933024640:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 372us (1204us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297245.605138:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 210 00010000:00010000:0.0:1789297245.632157:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297245.638909:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.639060:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024768 00000100:00100000:0.0:1789297245.639097:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024768 00000100:00100000:0.0:1789297245.639157:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:0.0:1789297245.639168:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8141:x1876213933024768:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297245.639458:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8141:x1876213933024768:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 291us (558us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.639467:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:3.0:1789297245.649815:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297245.649938:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933024896 00000100:00100000:2.0:1789297245.649955:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933024896 00000100:00100000:2.0:1789297245.650039:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00100000:2.0:1789297245.650053:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:8138:x1876213933024896:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:2.0:1789297245.650075:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297245.650109:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20062c00/0x8ad177e823a0b4ba lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d87b expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297245.650174:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062c00/0x8ad177e823a0b4ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d87b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297245.650187:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20062c00/0x8ad177e823a0b4ba lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d87b expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297245.650196:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20062c00, rc 0) 00000100:00100000:2.0:1789297245.650263:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:8138:x1876213933024896:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 213us (461us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297245.650271:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00100000:3.0:1789297245.659093:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297245.659208:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025024 00000100:00100000:1.0:1789297245.659219:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025024 00000100:00100000:1.0:1789297245.659301:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 213 00000100:00100000:1.0:1789297245.659313:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:8138:x1876213933025024:12345-192.168.202.43@tcp:256:mount.lustre.0 20000000:01000000:1.0:1789297245.659340:0:5835:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1789297245.659366:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1789297245.659370:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1789297245.659373:0:5835:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1789297245.659375:0:5835:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1789297245.662377:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:8138:x1876213933025024:12345-192.168.202.43@tcp:256:mount.lustre.0 Request processed in 3053us (3281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297245.662395:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 213 00000100:00100000:3.0:1789297245.668497:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.668670:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025152 00000100:00100000:0.0:1789297245.668682:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025152 00000100:00100000:0.0:1789297245.668796:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 214 00000100:00100000:0.0:1789297245.668808:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:8138:x1876213933025152:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789297245.668829:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297245.668851:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d882 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297245.668884:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297245.668896:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297245.668906:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bae00, rc 0) 00000100:00100000:0.0:1789297245.668969:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8138:x1876213933025152:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 163us (485us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.668975:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 214 00000100:00100000:3.0:1789297245.671847:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297245.671990:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025280 00000100:00100000:1.0:1789297245.672000:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025280 00000100:00100000:1.0:1789297245.672064:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00100000:1.0:1789297245.672076:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8138:x1876213933025280:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789297245.673268:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8138:x1876213933025280:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 576us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297245.673280:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00100000:3.0:1789297245.675726:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297245.675926:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025408 00000100:00100000:2.0:1789297245.675937:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025408 00000100:00100000:2.0:1789297245.676005:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 216 00000100:00100000:2.0:1789297245.676016:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8138:x1876213933025408:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:2.0:1789297245.676279:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8138:x1876213933025408:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 263us (595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297245.676288:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 216 00000100:00100000:3.0:1789297245.680228:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297245.690947:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025536 00000100:00100000:1.0:1789297245.690971:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025536 00000100:00100000:1.0:1789297245.691075:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 217 00000100:00100000:1.0:1789297245.691089:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8145:x1876213933025536:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789297245.694013:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8145:x1876213933025536:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 2913us (13780us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297245.694028:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 217 00000100:00100000:3.0:1789297245.710392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.710551:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025664 00000100:00100000:0.0:1789297245.710562:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025664 00000100:00100000:0.0:1789297245.710624:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 218 00000100:00100000:0.0:1789297245.710636:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8145:x1876213933025664:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297245.710991:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:8145:x1876213933025664:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 344us (597us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.711001:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 218 00000100:00100000:3.0:1789297245.722571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.723115:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026176 00000100:00100000:0.0:1789297245.723127:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026176 00000100:00100000:0.0:1789297245.723253:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789297245.723266:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933026176:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297245.723371:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933026176:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 107us (813us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.723379:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00080000:3.0:1789297245.724153:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297245.725281:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297245.727114:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025792 00000100:00100000:1.0:1789297245.727130:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025792 00000100:00100000:1.0:1789297245.727192:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789297245.727201:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2352:x1876213933025792:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789297245.727236:0:7920:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from e029f0c5-35c9-4fe9-a40d-3a0871f25c48@192.168.202.43@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:1.0:1789297245.727279:0:7920:0:(genops.c:1385:class_connect()) connect: client e029f0c5-35c9-4fe9-a40d-3a0871f25c48, cookie 0x8ad177e823a0b4c8 00000004:00100000:1.0:1789297245.727394:0:7920:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:1.0:1789297245.734089:0:7920:0:(import.c:65:import_set_state_nolock()) ffff982b27c37000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789297245.737558:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2352:x1876213933025792:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 10343us (12273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.737573:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297245.750603:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.750762:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933025920 00000100:00100000:0.0:1789297245.750775:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933025920 00000100:00100000:0.0:1789297245.750867:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:0.0:1789297245.750878:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:0:x1876213933025920:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789297245.750929:0:5842:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789297245.751078:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40942300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:0:x1876213933025920:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 201us (811us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.751085:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00080000:3.0:1789297245.751778:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297245.754835:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.754909:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026048 00000100:00100000:0.0:1789297245.754921:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026048 00000100:00100000:0.0:1789297245.755006:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:0.0:1789297245.755018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:8138:x1876213933026048:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:0.0:1789297245.755067:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1789297245.755133:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:8138:x1876213933026048:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 117us (308us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.755140:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:3.0:1789297245.786403:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.786566:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026304 00000100:00100000:0.0:1789297245.786578:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026304 00000100:00100000:0.0:1789297245.786646:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:0.0:1789297245.786657:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:8138:x1876213933026304:12345-192.168.202.43@tcp:40:mount.lustre.0 00000100:00100000:0.0:1789297245.786795:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:8138:x1876213933026304:12345-192.168.202.43@tcp:40:mount.lustre.0 Request processed in 140us (403us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297245.786804:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:0.0:1789297245.795974:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.796024:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297245.796059:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297245.796190:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026688 00000100:00100000:3.0:1789297245.796203:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026688 00000100:00100000:3.0:1789297245.796262:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:3.0:1789297245.796273:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:8138:x1876213933026688:12345-192.168.202.43@tcp:33:mount.lustre.0 00000004:00200000:3.0:1789297245.796376:0:5845:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789297245.796975:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:8138:x1876213933026688:12345-192.168.202.43@tcp:33:mount.lustre.0 Request processed in 702us (1009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297245.796995:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:2.0:1789297245.812372:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026432 00000100:00100000:2.0:1789297245.812391:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026432 00000100:00100000:2.0:1789297245.812468:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026560 00000100:00100000:2.0:1789297245.812472:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026560 00000100:00100000:2.0:1789297245.812492:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:2.0:1789297245.812501:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876213933026432:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789297245.812536:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from e029f0c5-35c9-4fe9-a40d-3a0871f25c48@192.168.202.43@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1789297245.812567:0:6687:0:(genops.c:1385:class_connect()) connect: client e029f0c5-35c9-4fe9-a40d-3a0871f25c48, cookie 0x8ad177e823a0b4cf 00002000:00100000:2.0:1789297245.812593:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli e029f0c5-35c9-4fe9-a40d-3a0871f25c48/ffff982b39c17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789297245.812620:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789297245.812896:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1789297245.824615:0:6687:0:(import.c:65:import_set_state_nolock()) ffff982b39c13800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297245.824750:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2352:x1876213933026432:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 12244us (28719us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297245.824762:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:2.0:1789297245.824801:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789297245.824808:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876213933026560:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789297245.824838:0:6687:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from e029f0c5-35c9-4fe9-a40d-3a0871f25c48@192.168.202.43@tcp t0 exp 0000000000000000 cur 257 last 0 00000020:00000080:2.0:1789297245.824869:0:6687:0:(genops.c:1385:class_connect()) connect: client e029f0c5-35c9-4fe9-a40d-3a0871f25c48, cookie 0x8ad177e823a0b4d6 00002000:00100000:2.0:1789297245.824883:0:6687:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli e029f0c5-35c9-4fe9-a40d-3a0871f25c48/ffff982b39c15800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789297245.824910:0:6687:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789297245.825965:0:6687:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789297245.827541:0:6687:0:(import.c:65:import_set_state_nolock()) ffff982b39c16000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297245.827642:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2352:x1876213933026560:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 2827us (31576us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297245.827654:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00010000:00010000:1.0:1789297246.654540:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297247.679084:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297248.196090:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957176576:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196180:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297248.196237:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789297248.196244:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957176192:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196273:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297248.196296:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957176704:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196322:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297248.196350:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957176320:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196387:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297248.196566:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957176832:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196590:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297248.196610:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297248.196615:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957176448:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196637:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297248.196685:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176576 00000100:00100000:3.0:1789297248.196693:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176576 00000100:00100000:3.0:1789297248.196779:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176832 00000100:00100000:3.0:1789297248.196783:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176832 00000100:00100000:3.0:1789297248.196801:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789297248.196809:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957176576:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196862:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957176576:12345-0@lo:400:kworker.0 Request processed in 53us (682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297248.196869:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1789297248.196886:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789297248.196892:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957176832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.196922:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957176832:12345-0@lo:400:kworker.0 Request processed in 30us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297248.196936:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1789297248.196953:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176192 00000100:00100000:3.0:1789297248.196957:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176192 00000100:00100000:3.0:1789297248.196977:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789297248.196983:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957176192:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.197014:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957176192:12345-0@lo:400:kworker.0 Request processed in 31us (740us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297248.197020:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00100000:3.0:1789297248.197044:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176704 00000100:00100000:3.0:1789297248.197047:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176704 00000100:00100000:3.0:1789297248.197071:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176320 00000100:00100000:3.0:1789297248.197073:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176320 00000100:00100000:3.0:1789297248.197085:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176448 00000100:00100000:3.0:1789297248.197087:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176448 00000100:00100000:3.0:1789297248.197101:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789297248.197106:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957176704:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.197136:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957176704:12345-0@lo:400:kworker.0 Request processed in 30us (813us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297248.197141:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789297248.197152:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789297248.197157:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957176320:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.197181:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957176320:12345-0@lo:400:kworker.0 Request processed in 24us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297248.197188:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789297248.197198:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789297248.197203:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957176448:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.197239:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957176448:12345-0@lo:400:kworker.0 Request processed in 36us (601us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297248.197245:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00080000:3.0:1789297248.197284:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789297248.197289:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297248.197290:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297248.197326:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957176448:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.197337:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957176320:0@lo:400:kworker.0 00010000:00080000:3.0:1789297248.197349:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40cb4a80 x1876213957176832/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297248.197360:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40cb4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957176832:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.200803:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957176192:0@lo:400:kworker.0 00000100:00100000:3.0:1789297248.200823:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957176704:0@lo:400:kworker.0 00010000:00080000:3.0:1789297248.200839:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39ca2d80 x1876213957176576/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297264 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297248.200850:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957176576:0@lo:400:kworker.0 00000001:00100000:3.0:1789297248.277869:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000100:00100000:2.0:1789297248.704137:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957176960:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297248.704215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297248.704303:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957176960 00000100:00100000:2.0:1789297248.704311:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957176960 00000100:00100000:2.0:1789297248.704358:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789297248.704367:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957176960:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1789297248.704416:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297248.704461:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957176960:12345-0@lo:13:osp-pre-1-0.0 Request processed in 94us (245us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297248.704469:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00010000:00080000:2.0:1789297248.704512:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b1c00 x1876213957176960/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297264 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297248.704532:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957176960:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789297248.705064:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297249.215013:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957177088:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297249.215090:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297249.215397:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177088 00000100:00100000:0.0:1789297249.215406:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177088 00000100:00100000:0.0:1789297249.215476:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1789297249.215488:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957177088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297249.215529:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297249.215584:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957177088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 99us (493us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297249.215592:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:0.0:1789297249.215639:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b385a3480 x1876213957177088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297265 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297249.215671:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957177088:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789297249.741101:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789297250.291861:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000001:00100000:3.0:1789297250.313533:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00010000:00010000:1.0:1789297250.749941:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297250.796428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297250.796473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297250.796509:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026816 00000100:00100000:0.0:1789297250.796509:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297250.796523:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026816 00000100:00100000:0.0:1789297250.796551:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297250.796586:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297250.796597:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 220 00000100:00100000:2.0:1789297250.796612:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933026816:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297250.796615:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027072 00000100:00100000:0.0:1789297250.796621:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027072 00000100:00100000:0.0:1789297250.796677:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933026944 00000100:00100000:0.0:1789297250.796681:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933026944 00000100:00100000:0.0:1789297250.796736:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:2.0:1789297250.796744:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933026816:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 134us (326us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297250.796749:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027072:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297250.796758:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 220 00000100:00100000:0.0:1789297250.796788:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027072:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 44us (313us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297250.796796:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:0.0:1789297250.796812:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:0.0:1789297250.796819:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933026944:12345-192.168.202.43@tcp:400:kworker.0 00000100:00080000:2.0:1789297250.796832:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297250.796845:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933026944:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (292us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297250.796848:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027328 00000100:00100000:2.0:1789297250.796854:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027328 00000100:00100000:0.0:1789297250.796854:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789297250.796892:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027200 00000100:00100000:2.0:1789297250.796896:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027200 00000100:00100000:2.0:1789297250.796918:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:2.0:1789297250.796927:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027328:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297250.796959:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027328:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 33us (449us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297250.796965:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:2.0:1789297250.796978:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:2.0:1789297250.797000:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027200:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297250.797197:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027200:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 197us (610us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297250.797204:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00080000:2.0:1789297250.797223:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789297250.797228:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:0.0:1789297251.773949:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1789297252.311100:0:10316:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-client.virtnet: executing check_config_client /mnt/lustre 00010000:00010000:1.0:1789297252.797523:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297253.311179:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957177344:0@lo:400:kworker.0 00000100:00100000:2.0:1789297253.311264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297253.311351:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177344 00000100:00100000:2.0:1789297253.311359:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177344 00000100:00100000:2.0:1789297253.311404:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789297253.311415:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957177344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297253.311484:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957177344:12345-0@lo:400:kworker.0 Request processed in 71us (220us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297253.311491:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789297253.311532:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957177344:0@lo:400:kworker.0 00000100:00100000:2.0:1789297253.311565:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957177472:0@lo:400:kworker.0 00000100:00100000:2.0:1789297253.311588:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297253.311662:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789297253.311668:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957177856:0@lo:400:kworker.0 00000100:00100000:2.0:1789297253.311695:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297253.311753:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177856 00000100:00100000:2.0:1789297253.311757:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177856 00000100:00100000:2.0:1789297253.311791:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1789297253.311798:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957177856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297253.311845:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957177856:12345-0@lo:400:kworker.0 Request processed in 48us (151us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297253.311852:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:2.0:1789297253.311867:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1789297253.311888:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40941500 x1876213957177856/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297253.311899:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957177856:0@lo:400:kworker.0 00000100:00100000:1.0:1789297253.312065:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957177216:0@lo:400:kworker.0 00000100:00100000:1.0:1789297253.312097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297253.312126:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957177728:0@lo:400:kworker.0 00000100:00100000:1.0:1789297253.312145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297253.312158:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297253.312163:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957177600:0@lo:400:kworker.0 00000100:00100000:1.0:1789297253.312181:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297253.312256:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177472 00000100:00100000:0.0:1789297253.312261:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177472 00000100:00100000:0.0:1789297253.312295:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177728 00000100:00100000:0.0:1789297253.312297:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177728 00000100:00100000:0.0:1789297253.312310:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789297253.312316:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957177472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297253.312359:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957177472:12345-0@lo:400:kworker.0 Request processed in 43us (770us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297253.312366:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789297253.312377:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789297253.312382:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957177728:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297253.312407:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957177728:12345-0@lo:400:kworker.0 Request processed in 24us (260us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297253.312412:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1789297253.312437:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957177728:0@lo:400:kworker.0 00000100:00100000:0.0:1789297253.312465:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40940a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957177472:0@lo:400:kworker.0 00000100:00080000:1.0:1789297253.312589:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297253.312769:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177216 00000100:00100000:2.0:1789297253.312773:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177216 00000100:00100000:2.0:1789297253.312852:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:2.0:1789297253.312859:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957177216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297253.312904:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957177216:12345-0@lo:400:kworker.0 Request processed in 46us (806us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297253.312910:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:3.0:1789297253.313271:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177600 00000100:00100000:3.0:1789297253.313276:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177600 00000100:00100000:3.0:1789297253.313320:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789297253.313326:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957177600:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297253.313378:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957177600:12345-0@lo:400:kworker.0 Request processed in 52us (1196us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297253.313383:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00080000:3.0:1789297253.313399:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1789297253.314665:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40942a00 x1876213957177600/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297269 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297253.314682:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40942a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957177600:0@lo:400:kworker.0 00000100:00100000:0.0:1789297253.314695:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957177216:0@lo:400:kworker.0 00000100:00100000:1.0:1789297253.823382:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957177984:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297253.823452:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297253.823516:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957177984 00000100:00100000:1.0:1789297253.823523:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957177984 00000100:00100000:1.0:1789297253.823579:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1789297253.823589:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957177984:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297253.823637:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297253.823685:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957177984:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (231us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297253.823701:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:1.0:1789297253.823752:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b1f80 x1876213957177984/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297269 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297253.823768:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957177984:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297253.824393:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297254.332907:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789297254.332934:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957178112:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297254.333006:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297254.333071:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957178112 00000100:00100000:0.0:1789297254.333079:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957178112 00000100:00100000:0.0:1789297254.333142:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:0.0:1789297254.334720:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957178112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297254.334776:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297254.334874:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e68e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957178112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1722us (1865us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297254.334890:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00010000:00080000:2.0:1789297254.335184:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11e6b800 x1876213957178112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297270 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297254.335210:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e6b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957178112:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789297254.848462:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297255.869725:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297255.915580:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297255.915664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297255.915698:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297255.915752:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297255.915783:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297255.915814:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027840 00000100:00100000:3.0:1789297255.915826:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027840 00000100:00100000:3.0:1789297255.915883:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027968 00000100:00100000:3.0:1789297255.915887:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027968 00000100:00100000:3.0:1789297255.915905:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789297255.915916:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027840:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297255.916005:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027840:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 91us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297255.916014:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789297255.916031:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:3.0:1789297255.916038:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027968:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297255.916063:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12024850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027968:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297255.916069:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:1.0:1789297255.916309:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027584 00000100:00100000:1.0:1789297255.916315:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027584 00000100:00100000:1.0:1789297255.916346:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027712 00000100:00100000:1.0:1789297255.916350:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027712 00000100:00100000:1.0:1789297255.916380:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:1.0:1789297255.916388:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933027584:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297255.916419:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933027584:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 33us (852us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297255.916425:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:1.0:1789297255.916439:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:1.0:1789297255.916446:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027712:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297255.916469:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933027712:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297255.916495:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:2.0:1789297255.916867:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933027456 00000100:00100000:2.0:1789297255.916873:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933027456 00000100:00100000:2.0:1789297255.916911:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00100000:2.0:1789297255.916918:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933027456:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297255.916957:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933027456:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 40us (1258us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297255.916964:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00080000:3.0:1789297255.917623:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789297255.917639:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297255.917641:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789297256.893673:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297257.917394:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297258.429004:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957178496:0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429116:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297258.429186:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:2.0:1789297258.429193:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957178368:0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429215:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297258.429233:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957178880:0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297258.429289:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957178496 00000100:00100000:2.0:1789297258.429296:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957178496 00000100:00100000:2.0:1789297258.429348:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957178368 00000100:00100000:2.0:1789297258.429351:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957178368 00000100:00100000:2.0:1789297258.429370:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789297258.429378:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957178496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429431:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957178496:12345-0@lo:400:kworker.0 Request processed in 53us (315us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297258.429438:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789297258.429453:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789297258.429458:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957178368:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429482:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40942a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957178368:12345-0@lo:400:kworker.0 Request processed in 24us (266us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297258.429487:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789297258.429505:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957178880 00000100:00100000:2.0:1789297258.429508:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957178880 00000100:00100000:2.0:1789297258.429531:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1789297258.429536:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957178880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429566:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957178880:12345-0@lo:400:kworker.0 Request processed in 29us (309us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297258.429606:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00080000:2.0:1789297258.429637:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297258.429642:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297258.429675:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957178368:0@lo:400:kworker.0 00010000:00080000:2.0:1789297258.429690:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40943b80 x1876213957178880/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297258.429690:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957178240:0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429700:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957178880:0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429726:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957178496:0@lo:400:kworker.0 00000100:00100000:0.0:1789297258.429741:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297258.429765:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957178752:0@lo:400:kworker.0 00000100:00100000:0.0:1789297258.429787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297258.429789:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957178240 00000100:00100000:2.0:1789297258.429792:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957178240 00000100:00100000:0.0:1789297258.429803:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789297258.429808:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957178624:0@lo:400:kworker.0 00000100:00100000:2.0:1789297258.429816:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1789297258.429822:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957178240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297258.429846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297258.429852:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957178240:12345-0@lo:400:kworker.0 Request processed in 30us (110us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297258.429858:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:0.0:1789297258.429882:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957178240:0@lo:400:kworker.0 00000100:00100000:3.0:1789297258.429896:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957178624 00000100:00100000:3.0:1789297258.429903:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957178624 00000100:00100000:0.0:1789297258.429925:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957178752 00000100:00100000:0.0:1789297258.429930:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957178752 00000100:00080000:2.0:1789297258.429932:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297258.429964:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1789297258.429966:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789297258.429984:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957178752:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297258.429985:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957178624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297258.430027:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e68380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957178752:12345-0@lo:400:kworker.0 Request processed in 51us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297258.430033:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789297258.430047:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e68700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957178624:12345-0@lo:400:kworker.0 Request processed in 71us (199us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297258.430056:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789297258.430070:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40941f80 x1876213957178624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297274 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297258.430079:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957178624:0@lo:400:kworker.0 00000100:00100000:0.0:1789297258.430094:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957178752:0@lo:400:kworker.0 00000100:00080000:3.0:1789297258.430190:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789297258.941035:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297258.944275:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297258.944311:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957179008:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297258.944397:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297258.944775:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179008 00000100:00100000:0.0:1789297258.944785:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179008 00000100:00100000:0.0:1789297258.944846:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789297258.944873:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957179008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297258.944914:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297258.944969:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957179008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 98us (571us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297258.944977:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:0.0:1789297258.945018:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11e6a300 x1876213957179008/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297274 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297258.945039:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e6a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957179008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297259.453177:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789297259.453201:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957179136:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297259.453272:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297259.454100:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179136 00000100:00100000:2.0:1789297259.454111:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179136 00000100:00100000:2.0:1789297259.454179:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1789297259.454690:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957179136:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789297259.454757:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297259.455404:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957179136:12345-0@lo:13:osp-pre-0-0.0 Request processed in 718us (2128us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297259.455414:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:3.0:1789297259.456117:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40941c00 x1876213957179136/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297275 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297259.456146:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957179136:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789297259.969109:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297260.990936:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297261.057830:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297261.057875:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297261.057899:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297261.057917:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297261.057947:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297261.058037:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028352 00000100:00100000:3.0:1789297261.058047:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028352 00000100:00100000:3.0:1789297261.058104:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028224 00000100:00100000:3.0:1789297261.058107:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028224 00000100:00100000:1.0:1789297261.058510:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028096 00000100:00100000:1.0:1789297261.058515:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028096 00000100:00100000:1.0:1789297261.058568:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 224 00000100:00100000:1.0:1789297261.058578:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933028096:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297261.058658:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933028096:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 82us (840us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297261.058665:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 224 00000100:00100000:1.0:1789297261.058697:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:1.0:1789297261.058845:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933028352:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297261.058879:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933028352:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 176us (1004us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297261.058886:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:1.0:1789297261.058901:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:1.0:1789297261.058908:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933028224:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297261.058930:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933028224:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (1012us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297261.058936:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:3.0:1789297261.060623:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028608 00000100:00100000:3.0:1789297261.060637:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028608 00000100:00100000:3.0:1789297261.060693:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028480 00000100:00100000:3.0:1789297261.060697:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028480 00000100:00100000:3.0:1789297261.060741:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:3.0:1789297261.060753:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933028608:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297261.060828:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933028608:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 77us (2927us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297261.060835:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:3.0:1789297261.060851:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789297261.060857:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933028480:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297261.060882:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933028480:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (2935us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297261.060888:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00080000:3.0:1789297261.060904:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297261.060908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297261.060911:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789297262.016559:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297263.038899:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297263.549406:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957179648:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.549489:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297263.549570:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789297263.549578:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957179264:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.549610:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297263.549634:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957179776:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.549675:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297263.549731:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957179392:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.549756:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297263.549775:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957179904:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.549798:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297263.549816:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297263.549822:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957179520:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.549845:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297263.549875:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179648 00000100:00100000:2.0:1789297263.549884:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179648 00000100:00100000:2.0:1789297263.549933:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179904 00000100:00100000:2.0:1789297263.549936:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179904 00000100:00100000:2.0:1789297263.549957:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789297263.549965:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957179648:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550020:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957179648:12345-0@lo:400:kworker.0 Request processed in 55us (531us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297263.550028:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789297263.550046:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789297263.550053:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957179904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550084:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957179904:12345-0@lo:400:kworker.0 Request processed in 33us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297263.550090:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1789297263.550117:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179264 00000100:00100000:2.0:1789297263.550121:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179264 00000100:00100000:2.0:1789297263.550163:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789297263.550170:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957179264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550200:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957179264:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297263.550207:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1789297263.550237:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179776 00000100:00100000:2.0:1789297263.550241:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179776 00000100:00100000:2.0:1789297263.550265:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179392 00000100:00100000:2.0:1789297263.550267:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179392 00000100:00100000:2.0:1789297263.550278:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957179520 00000100:00100000:2.0:1789297263.550280:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957179520 00000100:00100000:2.0:1789297263.550293:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789297263.550299:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957179776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550329:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38290380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957179776:12345-0@lo:400:kworker.0 Request processed in 31us (653us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297263.550336:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789297263.550348:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789297263.550354:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957179392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550380:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38290700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957179392:12345-0@lo:400:kworker.0 Request processed in 27us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297263.550385:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1789297263.550395:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1789297263.550401:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957179520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550426:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38291880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957179520:12345-0@lo:400:kworker.0 Request processed in 26us (580us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297263.550441:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00080000:2.0:1789297263.550466:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789297263.550471:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297263.550473:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789297263.550502:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957179264:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550517:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40940380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957179776:0@lo:400:kworker.0 00010000:00080000:2.0:1789297263.550545:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40941c00 x1876213957179648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297263.550556:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957179648:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550593:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40942680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957179520:0@lo:400:kworker.0 00000100:00100000:2.0:1789297263.550603:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957179392:0@lo:400:kworker.0 00010000:00080000:2.0:1789297263.550612:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40941f80 x1876213957179904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297279 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297263.550621:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957179904:0@lo:400:kworker.0 00010000:00010000:3.0:1789297264.089824:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297264.089846:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957180032:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297264.089920:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297264.090007:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180032 00000100:00100000:3.0:1789297264.090016:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180032 00000100:00100000:3.0:1789297264.090064:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1789297264.090073:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957180032:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297264.090110:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297264.090174:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957180032:12345-0@lo:13:osp-pre-1-0.0 Request processed in 101us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297264.093132:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:3.0:1789297264.093243:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40cb7800 x1876213957180032/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297264.093272:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40cb7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957180032:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297264.574243:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957180160:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297264.574335:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297264.578816:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180160 00000100:00100000:3.0:1789297264.578831:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180160 00000100:00100000:3.0:1789297264.578885:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789297264.578895:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957180160:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297264.578934:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297264.579018:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957180160:12345-0@lo:13:osp-pre-0-0.0 Request processed in 124us (4682us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297264.579026:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00010000:00080000:3.0:1789297264.579075:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b38293480 x1876213957180160/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297280 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297264.579095:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957180160:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789297265.153168:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297266.160644:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297266.160695:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297266.160749:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297266.160782:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028736 00000100:00100000:3.0:1789297266.160792:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028736 00000100:00100000:3.0:1789297266.160864:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 226 00000100:00100000:3.0:1789297266.160875:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933028736:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297266.161354:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933028736:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 478us (719us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297266.161381:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 226 00000100:00100000:3.0:1789297266.161441:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297266.161581:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297266.161606:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933029120 00000100:00100000:3.0:1789297266.161611:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933029120 00000100:00100000:3.0:1789297266.161651:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933029248 00000100:00100000:3.0:1789297266.161654:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933029248 00000100:00100000:3.0:1789297266.161677:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:3.0:1789297266.161684:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2352:x1876213933029120:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:3.0:1789297266.161736:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b4cf 00000100:00080000:3.0:1789297266.161747:0:6687:0:(import.c:65:import_set_state_nolock()) ffff982b39c13800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789297266.162023:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789297266.162490:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+2:2352:x1876213933029120:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 800us (1042us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297266.162507:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:3.0:1789297266.162528:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789297266.162536:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2352:x1876213933029248:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:3.0:1789297266.162552:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b4d6 00000100:00080000:3.0:1789297266.162558:0:6687:0:(import.c:65:import_set_state_nolock()) ffff982b39c16000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789297266.162580:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1789297266.162787:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+2:2352:x1876213933029248:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 251us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297266.162976:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00080000:3.0:1789297266.163004:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297266.163008:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789297266.163019:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297266.163400:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297266.163642:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028992 00000100:00100000:3.0:1789297266.163650:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028992 00000100:00100000:3.0:1789297266.163695:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933028864 00000100:00100000:3.0:1789297266.163699:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933028864 00000100:00100000:3.0:1789297266.163746:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:3.0:1789297266.163754:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933028992:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297266.163888:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933028992:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 134us (3192us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297266.163896:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:3.0:1789297266.163910:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:3.0:1789297266.163917:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933028864:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297266.163942:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933028864:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 25us (3193us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297266.163947:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00080000:3.0:1789297266.163965:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1789297266.175223:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297267.197154:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297268.220981:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297268.687055:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957180288:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297268.687280:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957180800:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687309:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297268.687339:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297268.687345:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957180672:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297268.687400:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957180416:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687438:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297268.687455:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957180928:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687485:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297268.687503:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297268.687509:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957180544:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297268.687563:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180800 00000100:00100000:3.0:1789297268.687571:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180800 00000100:00100000:3.0:1789297268.687632:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180416 00000100:00100000:3.0:1789297268.687635:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180416 00000100:00100000:3.0:1789297268.687649:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180544 00000100:00100000:3.0:1789297268.687652:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180544 00000100:00100000:3.0:1789297268.687669:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789297268.687678:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957180800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687761:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957180800:12345-0@lo:400:kworker.0 Request processed in 84us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297268.687769:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1789297268.687787:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789297268.687792:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957180416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687822:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957180416:12345-0@lo:400:kworker.0 Request processed in 30us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297268.687828:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:3.0:1789297268.687840:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789297268.687846:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957180544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687873:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957180544:12345-0@lo:400:kworker.0 Request processed in 27us (340us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297268.687878:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789297268.687904:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180672 00000100:00100000:3.0:1789297268.687908:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180672 00000100:00100000:3.0:1789297268.687932:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180928 00000100:00100000:3.0:1789297268.687935:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180928 00000100:00100000:3.0:1789297268.687949:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789297268.687954:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957180672:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.687985:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957180672:12345-0@lo:400:kworker.0 Request processed in 30us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297268.687991:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789297268.688001:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:3.0:1789297268.688006:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957180928:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.688034:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957180928:12345-0@lo:400:kworker.0 Request processed in 27us (558us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297268.688039:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00080000:3.0:1789297268.688063:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297268.688067:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297268.688069:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1789297268.688096:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f56300 x1876213957180672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297268.688112:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957180672:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.688124:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957180800:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.688151:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957180544:0@lo:400:kworker.0 00000100:00100000:2.0:1789297268.689504:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957180288 00000100:00100000:2.0:1789297268.689516:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957180288 00000100:00100000:2.0:1789297268.689568:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789297268.689577:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957180288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297268.689658:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957180288:12345-0@lo:400:kworker.0 Request processed in 83us (2521us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297268.689664:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1789297268.689983:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957180288:0@lo:400:kworker.0 00000100:00100000:3.0:1789297268.692315:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957180416:0@lo:400:kworker.0 00010000:00080000:3.0:1789297268.692332:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11f56680 x1876213957180928/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297284 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297268.692360:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957180928:0@lo:400:kworker.0 00000001:00100000:2.0:1789297268.746353:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000020:00000080:2.0:1789297268.746363:0:6712:0:(genops.c:885:class_export_put()) final put ffff982b39c17800/e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000020:00000080:3.0:1789297268.746419:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982b39c17800/e029f0c5-35c9-4fe9-a40d-3a0871f25c48 for lustre-OST0000 00000020:00000080:3.0:1789297268.746531:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b39c13800 for lustre-OST0000 00000100:00100000:0.0:1789297269.182399:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957181056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297269.182502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297269.182753:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181056 00000100:00100000:3.0:1789297269.182772:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181056 00000100:00100000:3.0:1789297269.182833:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1789297269.182843:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957181056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297269.182882:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297269.182937:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957181056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (435us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297269.182945:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1789297269.183398:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bd180 x1876213957181056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297269.183432:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957181056:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789297269.244912:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297269.697737:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957181184:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297269.697821:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297269.697932:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181184 00000100:00100000:2.0:1789297269.697943:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181184 00000100:00100000:2.0:1789297269.697999:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1789297269.698009:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957181184:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1789297269.698045:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1789297269.702950:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957181184:12345-0@lo:13:osp-pre-0-0.0 Request processed in 4933us (5119us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297269.702965:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:1.0:1789297269.707875:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bea00 x1876213957181184/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297285 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297269.707916:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957181184:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789297270.269051:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789297270.767467:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000020:00000080:3.0:1789297270.767476:0:7644:0:(genops.c:885:class_export_put()) final put ffff982b39c15800/e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000020:00000080:0.0:1789297270.767555:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982b39c15800/e029f0c5-35c9-4fe9-a40d-3a0871f25c48 for lustre-OST0001 00000020:00000080:0.0:1789297270.767698:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b39c16000 for lustre-OST0001 00000001:02000400:3.0:1789297271.276798:0:11031:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:0.0:1789297271.288037:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297271.288553:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297271.288655:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933029504 00000100:00100000:3.0:1789297271.288667:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933029504 00000100:00100000:3.0:1789297271.288769:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:3.0:1789297271.288781:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933029504:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297271.288872:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e68a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933029504:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 93us (844us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297271.288881:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00080000:1.0:1789297271.289175:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297271.289462:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297271.289558:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933029632 00000100:00100000:3.0:1789297271.289563:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933029632 00000100:00080000:1.0:1789297271.289647:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297271.289683:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:3.0:1789297271.289691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933029632:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297271.289782:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e68000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933029632:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 92us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297271.289788:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:2.0:1789297271.290147:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933029376 00000100:00100000:2.0:1789297271.290152:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933029376 00000100:00100000:2.0:1789297271.290193:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 228 00000100:00100000:2.0:1789297271.290201:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933029376:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297271.290235:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933029376:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 35us (1684us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297271.290241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 228 00010000:00010000:3.0:1789297271.305578:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297272.316924:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297273.340906:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297273.790985:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957181312:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.791034:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957181440:0@lo:400:kworker.0 00000100:00100000:0.0:1789297273.791072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297273.791148:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297273.791189:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181312 00000100:00100000:0.0:1789297273.791198:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181312 00000100:00100000:0.0:1789297273.791243:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1789297273.791250:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957181312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297273.791298:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957181312:12345-0@lo:400:kworker.0 Request processed in 47us (226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297273.791306:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:3.0:1789297273.791361:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297273.791362:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957181312:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.791373:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957181568:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.791407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297273.791456:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181440 00000100:00100000:3.0:1789297273.791460:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181440 00000100:00100000:3.0:1789297273.791491:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181568 00000100:00100000:3.0:1789297273.791494:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181568 00000100:00100000:3.0:1789297273.791518:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:0.0:1789297273.791559:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789297273.791570:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957181440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297273.791572:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957181568:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.791621:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957181440:12345-0@lo:400:kworker.0 Request processed in 95us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297273.791628:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00080000:3.0:1789297273.791649:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297273.791671:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957181440:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.791869:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957181696:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.791902:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297273.791954:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957181568:12345-0@lo:400:kworker.0 Request processed in 385us (544us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297273.791963:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:3.0:1789297273.791982:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789297273.791990:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957181824:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.792140:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297273.792173:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181696 00000100:00100000:3.0:1789297273.792187:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181696 00000100:00100000:3.0:1789297273.792221:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1789297273.792228:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957181696:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297273.792275:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181824 00000100:00100000:0.0:1789297273.792280:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181824 00000100:00100000:0.0:1789297273.792311:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:0.0:1789297273.792318:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957181824:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297273.792370:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789297273.792383:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957181952:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.792413:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957181696:12345-0@lo:400:kworker.0 Request processed in 184us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297273.792420:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789297273.792445:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957181824:12345-0@lo:400:kworker.0 Request processed in 126us (303us total) trans 0 rc 0/0 00000100:00080000:3.0:1789297273.792454:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297273.792454:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00080000:3.0:1789297273.792460:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297273.792485:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957181568:0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.792509:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957181824:0@lo:400:kworker.0 00010000:00080000:3.0:1789297273.792520:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b0000 x1876213957181696/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297273.792542:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957181696:0@lo:400:kworker.0 00000100:00100000:1.0:1789297273.792626:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297273.793626:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957181952 00000100:00100000:3.0:1789297273.793636:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957181952 00000100:00100000:3.0:1789297273.793679:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1789297273.793687:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957181952:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297273.793767:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957181952:12345-0@lo:400:kworker.0 Request processed in 80us (1140us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297273.793774:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00080000:3.0:1789297273.793791:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1789297273.793814:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b067b3480 x1876213957181952/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297289 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297273.793826:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957181952:0@lo:400:kworker.0 00000100:00100000:0.0:1789297274.300946:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297274.300971:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957182080:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297274.301059:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297274.301177:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957182080 00000100:00100000:3.0:1789297274.301191:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957182080 00000100:00100000:3.0:1789297274.301242:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1789297274.301250:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957182080:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297274.301286:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297274.301337:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957182080:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (278us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297274.301345:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00080000:3.0:1789297274.301384:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bd180 x1876213957182080/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297274.301403:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957182080:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789297274.366674:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297274.814458:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957182208:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297274.814539:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297274.814808:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957182208 00000100:00100000:3.0:1789297274.814818:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957182208 00000100:00100000:3.0:1789297274.814872:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1789297274.814882:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957182208:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297274.814919:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297274.814968:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957182208:12345-0@lo:13:osp-pre-0-0.0 Request processed in 88us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297274.814976:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:1.0:1789297274.819415:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a024bd180 x1876213957182208/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297290 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297274.819455:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957182208:0@lo:13:osp-pre-0-0.0 00000020:00000080:2.0:1789297274.994080:0:11180:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffcc8e908f0 20000000:00000080:2.0:1789297274.994099:0:11180:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982b3fbdc800 uarg=0000000000000000 20000000:01000000:2.0:1789297274.994200:0:11180:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789297274.994207:0:11180:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1789297274.994213:0:11180:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:1.0:1789297274.997635:0:11181:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:2.0:1789297274.997959:0:11180:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:2.0:1789297275.003681:0:11180:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1789297275.003845:0:11180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.003870:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.003879:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.003886:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.003975:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.003984:0:11180:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.003992:0:11180:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.004106:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.004126:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 12 pid: 5837 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.004331:0:11180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182336:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297275.004760:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 12 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.004786:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 12 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.004797:0:11180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182464:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297275.004840:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.004848:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 18 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.004857:0:11180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38291180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182592:0@lo:104: 00000100:00100000:2.0:1789297275.004906:0:11180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789297275.004943:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.004951:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 18 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.004960:0:11180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38292680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182720:0@lo:104: 00000100:00100000:2.0:1789297275.004981:0:11180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1789297275.005011:0:11180:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 18 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.005030:0:11180:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 18 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.005038:0:11180:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38293b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182848:0@lo:104: 00000100:00100000:2.0:1789297275.005057:0:11180:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297275.005075:0:11180:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05798600 going to sleep for 11 seconds 00000100:00100000:3.0:1789297275.006044:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957182592 00000100:00100000:3.0:1789297275.006059:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957182592 00000100:00100000:3.0:1789297275.006104:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957182720 00000100:00100000:3.0:1789297275.006107:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957182720 00000100:00100000:3.0:1789297275.006118:0:5825:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957182848 00000100:00100000:3.0:1789297275.006120:0:5825:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957182848 00000100:00100000:3.0:1789297275.006135:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789297275.006145:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:11180:x1876213957182592:12345-0@lo:104: 00010000:00010000:3.0:1789297275.006171:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006251:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789297275.006257:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38292a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:11180:x1876213957182592:12345-0@lo:104: Request processed in 114us (1352us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297275.006264:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789297275.006284:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789297275.006290:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:11180:x1876213957182720:12345-0@lo:104: 00010000:00010000:3.0:1789297275.006298:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006331:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1789297275.006336:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:11180:x1876213957182720:12345-0@lo:104: Request processed in 46us (1355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297275.006342:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1789297275.006353:0:5825:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789297275.006358:0:5825:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:11180:x1876213957182848:12345-0@lo:104: 00010000:00010000:3.0:1789297275.006365:0:5825:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006396:0:5825:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1789297275.006401:0:5825:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38293100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:11180:x1876213957182848:12345-0@lo:104: Request processed in 43us (1343us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297275.006407:0:5825:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:3.0:1789297275.006437:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1789297275.006445:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006459:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb600 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297275.006463:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006471:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297275.006478:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297275.006484:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789297275.006521:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006527:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297275.006551:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006559:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b49e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b4a5 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006571:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789297275.006575:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006580:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297275.006583:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006600:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297275.006606:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297275.006611:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789297275.006626:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006631:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297275.006647:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006653:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059ba400/0x8ad177e823a0b490 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b497 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006663:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297275.006665:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006671:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297275.006673:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006679:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297275.006685:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297275.006696:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1789297275.006739:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006745:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297275.006751:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006757:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059ba800/0x8ad177e823a0b482 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b489 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.006769:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297275.006770:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297275.006772:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297275.006778:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297275.006785:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297275.006799:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957182976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297275.006838:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297275.006878:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957183104:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297275.006900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297275.006919:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297275.006925:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957183232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297275.006945:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297275.006975:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957182976 00000100:00100000:3.0:1789297275.006980:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957182976 00010000:00010000:3.0:1789297275.006998:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 19 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297275.007033:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957183104 00000100:00100000:3.0:1789297275.007037:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957183104 00010000:00010000:3.0:1789297275.007049:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 20 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297275.007058:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957183232 00000100:00100000:3.0:1789297275.007060:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957183232 00010000:00010000:3.0:1789297275.007068:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 21 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297275.007079:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789297275.007085:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3303:x1876213957182976:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789297275.007095:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297275.007100:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 21 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.007110:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 21 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.007127:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297275.007154:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3d850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3303:x1876213957182976:12345-0@lo:103:ldlm_bl.0 Request processed in 69us (315us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297275.007160:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789297275.007203:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789297275.007209:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3304:x1876213957183104:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789297275.007216:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297275.007220:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 20 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.007239:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 20 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.007249:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297275.007276:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3304:x1876213957183104:12345-0@lo:103:ldlm_bl.0 Request processed in 66us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297275.007282:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789297275.007294:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789297275.007300:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957183232:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789297275.007309:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297275.007313:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 19 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.007320:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 19 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.007329:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297275.007349:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957183232:12345-0@lo:103:ldlm_bl.0 Request processed in 50us (403us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297275.007355:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1789297275.007394:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957182976:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297275.007435:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957183232:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297275.007444:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f56680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957183104:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297275.007841:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059bb200/0x8ad177e823a0b4a5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b49e expref: 18 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.007854:0:11180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38291180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182592:0@lo:104: 00010000:00010000:2.0:1789297275.007864:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059bba00/0x8ad177e823a0b497 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b490 expref: 17 pid: 5835 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.007872:0:11180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38292680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182720:0@lo:104: 00010000:00010000:2.0:1789297275.007881:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059ba200/0x8ad177e823a0b489 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b482 expref: 16 pid: 5836 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.007889:0:11180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38293b80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182848:0@lo:104: 00000100:00100000:3.0:1789297275.016544:0:11180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290a80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182336:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297275.019762:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297275.020000:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933029760 00000100:00100000:0.0:1789297275.020011:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933029760 00010000:00010000:0.0:1789297275.020054:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 13 pid: 5837 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297275.020110:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789297275.020120:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933029760:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297275.020135:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297275.020141:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 13 pid: 5837 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297275.020165:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 13 pid: 5837 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297275.020187:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059bae00/0x8ad177e823a0b4c1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d882 expref: 13 pid: 5837 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297275.020204:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297275.020272:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:2354:x1876213933029760:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 153us (518us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297275.020280:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:3.0:1789297275.020674:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297275.020851:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933029888 00000100:00100000:1.0:1789297275.020856:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933029888 00010000:00010000:1.0:1789297275.020886:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 12 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297275.020922:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:1.0:1789297275.020931:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:2354:x1876213933029888:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297275.020940:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297275.020944:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 12 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.020954:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 12 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.020978:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.020987:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021005:0:5828:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021024:0:5828:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021032:0:5828:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021039:0:5828:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021046:0:5828:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20062600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297275.021050:0:5828:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021059:0:5828:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021068:0:5828:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297275.021080:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297275.021108:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:2354:x1876213933029888:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 179us (434us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297275.021125:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00010000:00010000:2.0:1789297275.021559:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059ba600/0x8ad177e823a0b4ac lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d84a expref: 11 pid: 5835 timeout: 386 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297275.021572:0:11180:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11180:1876213957182464:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297275.021608:0:11180:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.021618:0:11180:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.021625:0:11180:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297275.021630:0:11180:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062600/0x8ad177e823a0b4dd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11180 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297275.388943:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297276.140519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297276.140766:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030016 00000100:00100000:2.0:1789297276.140783:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030016 00000100:00100000:2.0:1789297276.140853:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 230 00000100:00100000:2.0:1789297276.140865:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:5598:x1876213933030016:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297276.140890:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297276.140913:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8ac expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.140943:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.140954:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.140965:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b20063600, rc 0) 00000100:00100000:2.0:1789297276.141263:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933030016:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 399us (751us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297276.141271:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 230 00000100:00100000:0.0:1789297276.143266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297276.143377:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030144 00000100:00100000:2.0:1789297276.143386:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030144 00000100:00100000:2.0:1789297276.143441:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:2.0:1789297276.143451:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933030144:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297276.145386:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933030144:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 1921us (2114us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297276.145401:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:1.0:1789297276.147505:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297276.147590:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030272 00000100:00100000:3.0:1789297276.147600:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030272 00000100:00100000:3.0:1789297276.147652:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 232 00000100:00100000:3.0:1789297276.147662:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933030272:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.148184:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933030272:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 521us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297276.148193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 232 00000100:00100000:1.0:1789297276.152352:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297276.152388:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030400 00000100:00100000:1.0:1789297276.152398:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030400 00000100:00100000:1.0:1789297276.152469:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:1.0:1789297276.152480:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933030400:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297276.152497:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297276.152516:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8b3 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.152547:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.152558:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 13 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.152569:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42176e00, rc 0) 00000100:00100000:1.0:1789297276.152621:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933030400:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 143us (276us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.152629:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:1.0:1789297276.157110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297276.157191:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030528 00000100:00100000:0.0:1789297276.157204:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030528 00000100:00100000:0.0:1789297276.157262:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 234 00000100:00100000:0.0:1789297276.157273:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933030528:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297276.157583:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933030528:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 311us (481us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297276.157592:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 234 00000100:00100000:1.0:1789297276.159106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297276.159157:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030656 00000100:00100000:3.0:1789297276.159166:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030656 00000100:00100000:3.0:1789297276.159219:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 235 00000100:00100000:3.0:1789297276.159228:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933030656:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.159435:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933030656:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 204us (331us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297276.159443:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 235 10000000:01000000:2.0:1789297276.348842:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789297276.348851:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a01db8800 from 7 10000000:01000000:2.0:1789297276.348856:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789297276.348906:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.348926:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.348939:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297276.348965:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183360:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789297276.349039:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297276.349096:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395000 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.349227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957183360 00000100:00100000:1.0:1789297276.349235:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957183360 00000100:00100000:1.0:1789297276.349291:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1789297276.349308:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957183360:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297276.349321:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297276.349334:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b4f2 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.349359:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.349371:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.349381:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42177200, rc 0) 00000100:00100000:1.0:1789297276.349435:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957183360:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 129us (396us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.349443:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:2.0:1789297276.349589:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183360:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297276.349604:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.349613:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297276.349668:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297276.349726:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297276.349744:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395000 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.349994:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957183488 00000100:00100000:1.0:1789297276.350000:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957183488 00000100:00100000:1.0:1789297276.350036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1789297276.350044:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957183488:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297276.351011:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957183488:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 961us (1277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.351022:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:2.0:1789297276.351133:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183488:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297276.351192:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183616:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297276.351235:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297276.351273:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395000 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.351667:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957183616 00000100:00100000:1.0:1789297276.351674:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957183616 00000100:00100000:1.0:1789297276.351746:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1789297276.351755:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957183616:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297276.351919:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957183616:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (683us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.351933:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:2.0:1789297276.353229:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183616:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789297276.354468:0:11220:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:2.0:1789297276.355054:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:2.0:1789297276.355100:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789297276.355112:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.355124:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297276.355135:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789297276.355137:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b121d2000 from 7 10000000:01000000:2.0:1789297276.355140:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789297276.355191:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.355200:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.355211:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297276.355235:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789297276.355299:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297276.355338:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395000 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.355602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957183744 00000100:00100000:1.0:1789297276.355610:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957183744 00000100:00100000:1.0:1789297276.355659:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1789297276.355670:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957183744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297276.355685:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297276.355724:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b500 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.355749:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.355759:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.355768:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42177600, rc 0) 00000100:00100000:1.0:1789297276.355815:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957183744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (516us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.355822:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1789297276.355963:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789297276.355979:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297276.355988:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297276.356044:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.356072:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297276.356102:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.356283:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957183872 00000100:00100000:1.0:1789297276.356288:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957183872 00000100:00100000:1.0:1789297276.356322:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1789297276.356330:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957183872:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297276.356597:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957183872:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 267us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.356604:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1789297276.356682:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957183872:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.356749:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184000:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.356790:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297276.356809:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.357322:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184000 00000100:00100000:1.0:1789297276.357329:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184000 00000100:00100000:1.0:1789297276.357367:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 241 00000100:00100000:1.0:1789297276.357375:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957184000:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297276.357556:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957184000:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 182us (764us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.357562:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 241 00000100:00100000:3.0:1789297276.357648:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184000:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789297276.360172:0:11221:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789297276.360587:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789297276.360615:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789297276.360628:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297276.360641:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297276.360652:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1789297276.360655:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b07359800 from 7 10000000:01000000:3.0:1789297276.360658:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789297276.360735:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297276.360744:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297276.360756:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297276.360789:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.360866:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297276.360907:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e43c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.362913:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184128 00000100:00100000:1.0:1789297276.362927:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184128 00000100:00100000:1.0:1789297276.362994:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789297276.363005:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957184128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297276.363023:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297276.363041:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b50e expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.363070:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.363081:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 19 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297276.363091:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b42176800, rc 0) 00000100:00100000:1.0:1789297276.363189:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957184128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 186us (2321us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.363196:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000100:00100000:2.0:1789297276.364512:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297276.364537:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297276.364549:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297276.364640:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297276.364722:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297276.364763:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395180 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.365870:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184256 00000100:00100000:1.0:1789297276.365880:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184256 00000100:00100000:1.0:1789297276.365934:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:1.0:1789297276.365944:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957184256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297276.366427:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957184256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 482us (1734us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.366436:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789297276.366516:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.366565:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297276.366612:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297276.366648:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789297276.366691:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184384 00000100:00100000:1.0:1789297276.366927:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184384 00000100:00100000:1.0:1789297276.366970:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:1.0:1789297276.366980:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957184384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297276.367130:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957184384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 152us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297276.367137:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00100000:3.0:1789297276.368767:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957184384:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789297276.369610:0:11222:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1789297276.369675:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1789297276.369738:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789297276.369751:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297276.369761:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297276.399740:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297276.399793:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297276.399989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030784 00000100:00100000:3.0:1789297276.400000:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030784 00000100:00100000:3.0:1789297276.400064:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933030912 00000100:00100000:3.0:1789297276.400068:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933030912 00000100:00100000:3.0:1789297276.400106:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:3.0:1789297276.400116:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933030784:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297276.400196:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933030784:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 83us (468us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297276.400204:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:3.0:1789297276.400222:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 90 00000100:00100000:3.0:1789297276.400228:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933030912:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297276.400254:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933030912:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (461us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297276.400267:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 90 00000100:00080000:3.0:1789297276.400288:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789297276.417869:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297277.437169:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297278.467394:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297278.909075:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957184512:0@lo:400:kworker.0 00000100:00100000:1.0:1789297278.909153:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297278.909210:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297278.909216:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957184640:0@lo:400:kworker.0 00000100:00100000:1.0:1789297278.909244:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297278.909281:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184512 00000100:00100000:1.0:1789297278.909289:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184512 00000100:00100000:1.0:1789297278.909343:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789297278.909351:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957184512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297278.909410:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957184512:12345-0@lo:400:kworker.0 Request processed in 59us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297278.909417:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00100000:1.0:1789297278.909446:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184640 00000100:00100000:1.0:1789297278.909450:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184640 00000100:00100000:1.0:1789297278.909473:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789297278.909478:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957184640:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297278.909515:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957184640:12345-0@lo:400:kworker.0 Request processed in 37us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297278.909521:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:1.0:1789297278.909671:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957184640:0@lo:400:kworker.0 00000100:00100000:1.0:1789297278.909681:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957184512:0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.909879:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957185152:0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.909909:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297278.909927:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297278.909932:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957185024:0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.909947:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297278.910076:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957184896:0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.910098:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297278.910113:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297278.910118:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957184768:0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.910134:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297278.910154:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185152 00000100:00100000:3.0:1789297278.910157:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185152 00000100:00100000:3.0:1789297278.910187:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184896 00000100:00100000:3.0:1789297278.910189:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184896 00000100:00100000:3.0:1789297278.910202:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789297278.910207:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957185152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.910237:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957185152:12345-0@lo:400:kworker.0 Request processed in 29us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297278.910242:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789297278.910252:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789297278.910257:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957184896:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.910280:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957184896:12345-0@lo:400:kworker.0 Request processed in 24us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297278.910293:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789297278.910308:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185024 00000100:00100000:3.0:1789297278.910310:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185024 00000100:00100000:3.0:1789297278.910326:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957184768 00000100:00100000:3.0:1789297278.910328:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957184768 00000100:00100000:3.0:1789297278.910339:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789297278.910344:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957185024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.910370:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957185024:12345-0@lo:400:kworker.0 Request processed in 26us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297278.910375:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:3.0:1789297278.910397:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789297278.910402:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957184768:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.910424:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957184768:12345-0@lo:400:kworker.0 Request processed in 22us (289us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297278.910429:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789297278.910444:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789297278.910448:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297278.910450:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789297278.910468:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957184768:0@lo:400:kworker.0 00010000:00080000:3.0:1789297278.910478:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef4000 x1876213957184896/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297278.910489:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957184896:0@lo:400:kworker.0 00000100:00100000:3.0:1789297278.910508:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957185024:0@lo:400:kworker.0 00010000:00080000:3.0:1789297278.910515:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef5500 x1876213957185152/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297294 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297278.911645:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957185152:0@lo:400:kworker.0 00000100:00100000:3.0:1789297279.424608:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957185280:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297279.424692:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297279.424789:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185280 00000100:00100000:3.0:1789297279.425474:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185280 00000100:00100000:3.0:1789297279.425544:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789297279.425554:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957185280:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297279.425592:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297279.425649:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957185280:12345-0@lo:13:osp-pre-1-0.0 Request processed in 95us (956us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297279.425657:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:3.0:1789297279.425699:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef5500 x1876213957185280/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297279.425742:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957185280:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297279.488406:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789297279.632076:0:11378:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00100000:0.0:1789297279.947192:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957185408:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297279.947280:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297279.949241:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185408 00000100:00100000:3.0:1789297279.949380:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185408 00000100:00100000:3.0:1789297279.949446:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789297279.949458:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957185408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297279.949508:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297279.961725:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957185408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12247us (14421us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297279.961743:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:0.0:1789297279.976504:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b41ef5500 x1876213957185408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297295 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297279.976542:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957185408:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789297280.512685:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297281.515758:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297281.515794:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297281.515818:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297281.515968:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933031040 00000100:00100000:1.0:1789297281.515979:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933031040 00000100:00100000:1.0:1789297281.516045:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 246 00000100:00100000:1.0:1789297281.516056:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933031040:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297281.516432:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933031040:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 376us (633us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297281.516440:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 246 00000100:00100000:1.0:1789297281.516476:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933031168 00000100:00100000:1.0:1789297281.516480:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933031168 00000100:00100000:1.0:1789297281.516514:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933031296 00000100:00100000:1.0:1789297281.516518:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933031296 00000100:00100000:1.0:1789297281.516537:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:1.0:1789297281.516544:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2356:x1876213933031168:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297281.516576:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38293b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2356:x1876213933031168:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 34us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297281.516582:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:1.0:1789297281.516593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:1.0:1789297281.516599:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2356:x1876213933031296:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297281.516634:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38292680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2356:x1876213933031296:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 36us (815us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297281.516640:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00080000:1.0:1789297281.516656:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789297281.533089:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297282.557069:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789297283.531032:0:11478:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 07:01:22 (1789297282) === 00010000:00010000:2.0:1789297283.581746:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297283.755387:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297283.757560:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297283.758142:0:5851:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933031552 00000100:00100000:0.0:1789297283.758153:0:5851:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933031552 00000100:00100000:0.0:1789297283.758217:0:5851:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297283.758227:0:5851:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:235dd3df-f928-4719-bb69-fc817cc2744f+6:9704:x1876213933031552:12345-192.168.202.43@tcp:700:mkdir.0 00000100:00100000:0.0:1789297283.758309:0:5851:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38291c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:235dd3df-f928-4719-bb69-fc817cc2744f+6:9704:x1876213933031552:12345-192.168.202.43@tcp:700:mkdir.0 Request processed in 83us (758us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297283.758316:0:5851:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00080000:2.0:1789297283.758509:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297283.758805:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933031424 00000100:00100000:1.0:1789297283.758811:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933031424 00000100:00100000:1.0:1789297283.758849:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:1.0:1789297283.758856:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933031424:12345-192.168.202.43@tcp:41:mkdir.0 00000004:00000024:1.0:1789297283.758884:0:5844:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:1.0:1789297283.758953:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38291180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933031424:12345-192.168.202.43@tcp:41:mkdir.0 Request processed in 97us (3577us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297283.758959:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:3.0:1789297283.770470:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297283.770524:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933031808 00000100:00100000:3.0:1789297283.770533:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933031808 00000100:00100000:3.0:1789297283.770586:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789297283.770597:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:9704:x1876213933031808:12345-192.168.202.43@tcp:36:mkdir.0 00010000:00010000:3.0:1789297283.771444:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297283.771528:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b3fd lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d835 expref: 6 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.771554:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b15d3ae00) 00010000:00010000:3.0:1789297283.771565:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297283.772294:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.772311:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.772323:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.772366:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.772375:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.772381:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297283.774170:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789297283.774188:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.774570:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.774577:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.774584:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297283.774589:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.774597:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.774613:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073e00) 00010000:00010000:3.0:1789297283.774616:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297283.774621:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.774627:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b51c lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297283.775096:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000990dc8ed reply state 000000004f11a6de transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297283.775107:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297283.775327:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:9704:x1876213933031808:12345-192.168.202.43@tcp:36:mkdir.0 Request processed in 4729us (4865us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1789297283.775345:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00010000:00010000:3.0:1789297283.778364:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.778400:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.778409:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.778415:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152be00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297283.778420:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.778428:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.778445:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982b03073a00) 00010000:00010000:3.0:1789297283.778448:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297283.778452:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.778457:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b523 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297283.794980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297283.795591:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933031936 00000100:00100000:1.0:1789297283.795605:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933031936 00000100:00100000:1.0:1789297283.795665:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:1.0:1789297283.795676:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:9705:x1876213933031936:12345-192.168.202.43@tcp:101:chmod.0 00010000:00010000:1.0:1789297283.795699:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297283.797910:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0b52a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8ba expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.798119:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b531 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.798135:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.798147:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297283.798185:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789297283.798189:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297283.798344:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b531 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.798395:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0b52a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ba expref: 8 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.798413:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b531 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ba expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.798421:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297283.798424:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297283.798426:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257200, rc 0) 00000100:00100000:2.0:1789297283.798565:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:9705:x1876213933031936:12345-192.168.202.43@tcp:101:chmod.0 Request processed in 2890us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297283.798573:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:2.0:1789297283.806788:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297283.807037:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933032192 00000100:00100000:3.0:1789297283.807048:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933032192 00000100:00100000:3.0:1789297283.807115:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:3.0:1789297283.807125:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:9705:x1876213933032192:12345-192.168.202.43@tcp:36:chmod.0 00010000:00010000:3.0:1789297283.807182:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297283.807222:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b531 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ba expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.807263:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297283.807275:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297283.807303:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.807316:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.807325:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297283.807657:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000081f8a087 reply state 00000000031f0f5a transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297283.807667:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:3.0:1789297283.807674:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:3.0:1789297283.807807:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38292d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+8:9705:x1876213933032192:12345-192.168.202.43@tcp:36:chmod.0 Request processed in 682us (1028us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1789297283.807814:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00010000:00010000:2.0:1789297283.814783:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.814800:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.814806:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.814810:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152be00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297283.814814:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.814819:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.814848:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073a00) 00010000:00010000:2.0:1789297283.814850:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789297283.814854:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.814858:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b538 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297283.846976:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297283.847084:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933032320 00000100:00100000:0.0:1789297283.847095:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933032320 00000100:00100000:0.0:1789297283.847152:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789297283.847163:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:9706:x1876213933032320:12345-192.168.202.43@tcp:101:chown.0 00010000:00010000:0.0:1789297283.847187:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297283.847210:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b53f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8c1 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.847275:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b546 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.847290:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.847319:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297283.847386:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789297283.847390:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297283.847431:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b546 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.847458:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b53f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8c1 expref: 9 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.847481:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b546 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8c1 expref: 8 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.847490:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b15d3ab00) 00010000:00010000:0.0:1789297283.847492:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789297283.847496:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba200, rc 0) 00000100:00100000:0.0:1789297283.847561:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38291f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:9706:x1876213933032320:12345-192.168.202.43@tcp:101:chown.0 Request processed in 400us (596us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297283.847569:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789297283.860034:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297283.860221:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933032448 00000100:00100000:3.0:1789297283.860233:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933032448 00000100:00100000:3.0:1789297283.860301:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789297283.860313:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+8:9706:x1876213933032448:12345-192.168.202.43@tcp:101:chown.0 00010000:00010000:3.0:1789297283.860350:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297283.860377:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b54d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8c8 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860454:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860489:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860502:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860522:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860529:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860536:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860641:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b562 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860652:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860659:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297283.860696:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789297283.860700:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297283.860792:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b562 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860808:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860824:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860834:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860841:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297283.860846:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860857:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860870:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b15d3ab00) 00010000:00010000:3.0:1789297283.860921:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297283.860926:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860933:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b554 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860951:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860957:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860964:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860972:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297283.860981:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.860988:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.861000:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982b03073e00) 00010000:00010000:3.0:1789297283.861003:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297283.861005:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.861011:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b55b lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.861176:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b54d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8c8 expref: 10 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.861195:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b562 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8c8 expref: 9 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.861203:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b03073200) 00010000:00010000:3.0:1789297283.861205:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297283.861208:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a000, rc 0) 00000100:00100000:3.0:1789297283.861286:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+9:9706:x1876213933032448:12345-192.168.202.43@tcp:101:chown.0 Request processed in 975us (1262us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297283.861293:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789297283.871859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297283.871985:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933032704 00000100:00100000:0.0:1789297283.871998:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933032704 00000100:00100000:0.0:1789297283.872082:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789297283.872095:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+9:9706:x1876213933032704:12345-192.168.202.43@tcp:36:chown.0 00010000:00010000:0.0:1789297283.872169:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297283.872197:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b562 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8c8 expref: 9 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.872231:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297283.872247:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297283.872273:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.872285:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297283.872295:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297283.916039:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f4c996ac reply state 0000000036a2e1c3 transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297283.916066:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1789297283.916082:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789297283.916308:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+10:9706:x1876213933032704:12345-192.168.202.43@tcp:36:chown.0 Request processed in 44212us (44459us total) trans 4294967299 rc 0/0 00000100:00100000:2.0:1789297283.916317:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000001:00080000:3.0:1789297283.916476:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:2.0:1789297283.916537:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.916546:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.916554:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.916560:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297283.916565:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.916591:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.916607:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b15d3a000) 00010000:00010000:2.0:1789297283.916610:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1789297283.916614:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.916620:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b569 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297283.932519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297283.932611:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933032832 00000100:00100000:1.0:1789297283.932622:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933032832 00000100:00100000:1.0:1789297283.932694:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789297283.932729:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:9707:x1876213933032832:12345-192.168.202.43@tcp:101:touch.500 00010000:00010000:1.0:1789297283.932756:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297283.932778:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b42177400/0x8ad177e823a0b570 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8cf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789297283.937659:0:5843:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 4814us 00010000:00010000:2.0:1789297283.953127:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953151:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953164:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953179:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953185:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953191:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953540:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b585 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953555:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953562:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297283.953586:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789297283.953590:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297283.953629:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b585 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953642:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953650:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953657:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953664:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297283.953668:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953675:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953687:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b15d3ab00) 00010000:00010000:2.0:1789297283.953690:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297283.953694:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953731:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b577 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953742:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953747:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953752:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953756:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297283.953759:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953764:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953771:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982b2ac85f00) 00010000:00010000:2.0:1789297283.953773:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297283.953775:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953780:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b57e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953823:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b42177400/0x8ad177e823a0b570 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8cf expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953839:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b585 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8cf expref: 7 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.953853:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:2.0:1789297283.953855:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789297283.953857:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256400, rc 0) 00000100:00100000:2.0:1789297283.955176:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:9707:x1876213933032832:12345-192.168.202.43@tcp:101:touch.500 Request processed in 22464us (22660us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297283.955189:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789297283.960419:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297283.960513:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933033088 00000100:00100000:1.0:1789297283.960524:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933033088 00000100:00100000:1.0:1789297283.960619:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:1.0:1789297283.960631:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:9707:x1876213933033088:12345-192.168.202.43@tcp:101:touch.500 00010000:00010000:1.0:1789297283.960655:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297283.960677:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b42177800/0x8ad177e823a0b58c lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8d6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.961200:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.961217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.961230:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.961259:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.961267:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.961274:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789297283.963272:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:1.0:1789297283.963609:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b5a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963636:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963648:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b5a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963684:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963691:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963698:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963724:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b42176200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297283.963728:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963736:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963749:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:1.0:1789297283.963752:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297283.963756:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963763:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b42176200/0x8ad177e823a0b593 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789297283.963775:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e6d8c8fd reply state 000000004d6f17d5 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297283.963789:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789297283.963830:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b42177800/0x8ad177e823a0b58c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8d6 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963847:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b5a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8d6 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297283.963856:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b08585000) 00010000:00010000:1.0:1789297283.963858:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297283.963860:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2800, rc 0) 00000100:00100000:1.0:1789297283.964241:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38293800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+10:9707:x1876213933033088:12345-192.168.202.43@tcp:101:touch.500 Request processed in 3610us (3830us total) trans 4294967300 rc 0/0 00000100:00100000:1.0:1789297283.964250:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00010000:00010000:2.0:1789297283.967863:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.967881:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.967889:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.967896:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297283.967901:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.967910:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.967945:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff982b08585d00) 00010000:00010000:2.0:1789297283.967949:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297283.967954:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.967961:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0b59a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297283.969592:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297283.970259:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933033344 00000100:00100000:3.0:1789297283.970282:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933033344 00000100:00100000:3.0:1789297283.970358:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:3.0:1789297283.970369:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+9:9707:x1876213933033344:12345-192.168.202.43@tcp:36:touch.500 00010000:00010000:3.0:1789297283.970430:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297283.970457:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b5a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8d6 expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.970475:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b08585000) 00010000:00010000:3.0:1789297283.970486:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297283.970533:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.970548:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.970558:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297283.970692:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f5839abb reply state 00000000e882a9e0 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297283.970896:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297283.971368:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38290e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+10:9707:x1876213933033344:12345-192.168.202.43@tcp:36:touch.500 Request processed in 999us (1784us total) trans 4294967301 rc 0/0 00000100:00100000:3.0:1789297283.971377:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:0.0:1789297283.974921:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297283.974996:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933033472 00000100:00100000:3.0:1789297283.975007:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933033472 00000100:00100000:3.0:1789297283.975076:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:3.0:1789297283.975086:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+10:9707:x1876213933033472:12345-192.168.202.43@tcp:101:touch.500 00010000:00010000:3.0:1789297283.975130:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297283.975151:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b5b6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8dd expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.975221:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8dd expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.975237:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b5b6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8dd expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297283.975254:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b03073b00) 00010000:00010000:3.0:1789297283.975257:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789297283.975260:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b800, rc 0) 00000100:00100000:3.0:1789297283.975313:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+11:9707:x1876213933033472:12345-192.168.202.43@tcp:101:touch.500 Request processed in 230us (408us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297283.975320:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00010000:00010000:2.0:1789297283.978130:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.978149:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.978270:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.978277:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297283.978282:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.978291:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.978309:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b03073b00) 00010000:00010000:2.0:1789297283.978311:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297283.978315:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297283.978322:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5af lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297283.979179:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297283.979244:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933033600 00000100:00100000:3.0:1789297283.979255:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933033600 00000100:00100000:3.0:1789297283.979297:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:3.0:1789297283.979305:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876213933033600:12345-192.168.202.43@tcp:8:touch.500 00010000:00080000:3.0:1789297283.979350:0:6688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp t0 exp 0000000000000000 cur 295 last 0 00000020:00000080:3.0:1789297283.979380:0:6688:0:(genops.c:1385:class_connect()) connect: client 235dd3df-f928-4719-bb69-fc817cc2744f, cookie 0x8ad177e823a0b5bd 00002000:00100000:3.0:1789297283.979392:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 235dd3df-f928-4719-bb69-fc817cc2744f/ffff982b40a2c800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789297283.979416:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789297283.979654:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789297283.979685:0:6688:0:(import.c:65:import_set_state_nolock()) ffff982b40a2f000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789297283.979815:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2352:x1876213933033600:12345-192.168.202.43@tcp:8:touch.500 Request processed in 509us (641us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297283.979824:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:3.0:1789297283.982473:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297283.982571:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933033728 00000100:00100000:1.0:1789297283.982580:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933033728 00000100:00100000:1.0:1789297283.982649:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:1.0:1789297283.982665:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:0:x1876213933033728:12345-192.168.202.43@tcp:2:touch.500 00000100:00080000:2.0:1789297283.983429:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297284.018038:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:0:x1876213933033728:12345-192.168.202.43@tcp:2:touch.500 Request processed in 35368us (35563us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789297284.020151:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297284.020422:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000001:00080000:2.0:1789297284.020543:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:2.0:1789297284.020560:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000100:00100000:2.0:1789297284.022874:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933033984 00000100:00100000:2.0:1789297284.022906:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933033984 00000100:00100000:2.0:1789297284.023281:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:2.0:1789297284.023294:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+10:9707:x1876213933033984:12345-192.168.202.43@tcp:35:touch.500 00000100:00100000:2.0:1789297284.023680:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+11:9707:x1876213933033984:12345-192.168.202.43@tcp:35:touch.500 Request processed in 388us (3539us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789297284.023687:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:2.0:1789297284.030546:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957185792:0@lo:400:kworker.0 00000100:00100000:2.0:1789297284.030620:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297284.030680:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297284.030686:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957185920:0@lo:400:kworker.0 00000100:00100000:2.0:1789297284.030724:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297284.030762:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185920 00000100:00100000:2.0:1789297284.030771:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185920 00000100:00100000:2.0:1789297284.030828:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789297284.030839:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957185920:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297284.030891:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957185920:12345-0@lo:400:kworker.0 Request processed in 55us (165us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297284.030898:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789297284.031050:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957185536:0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031098:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297284.031122:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957186048:0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031141:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297284.031171:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1789297284.031191:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957185664:0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031211:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297284.031225:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957186176:0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031241:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297284.031264:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185536 00000100:00100000:1.0:1789297284.031267:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185536 00000100:00100000:1.0:1789297284.031298:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789297284.031304:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957185536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031345:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957185536:12345-0@lo:400:kworker.0 Request processed in 41us (246us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297284.031352:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 247 00000100:00100000:1.0:1789297284.031377:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185792 00000100:00100000:1.0:1789297284.031380:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185792 00000100:00100000:1.0:1789297284.031401:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186048 00000100:00100000:1.0:1789297284.031403:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186048 00000100:00100000:1.0:1789297284.031415:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957185664 00000100:00100000:1.0:1789297284.031417:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957185664 00000100:00100000:1.0:1789297284.031427:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789297284.031432:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957185792:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031458:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40942680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957185792:12345-0@lo:400:kworker.0 Request processed in 25us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297284.031464:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789297284.031472:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789297284.031477:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957186048:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031496:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957186048:12345-0@lo:400:kworker.0 Request processed in 19us (354us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297284.031502:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1789297284.031517:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789297284.031522:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957185664:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031543:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957185664:12345-0@lo:400:kworker.0 Request processed in 22us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297284.031548:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1789297284.031586:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38293480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957185664:0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031594:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957185536:0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031602:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957186048:0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.031624:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186176 00000100:00100000:1.0:1789297284.031626:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186176 00000100:00080000:0.0:1789297284.032364:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789297284.032372:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1789297284.032374:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297284.032454:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789297284.032468:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957186176:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297284.032521:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957186176:12345-0@lo:400:kworker.0 Request processed in 60us (1279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297284.032527:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:2.0:1789297284.036072:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40cb5880 x1876213957185920/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297284.036095:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40cb5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957185920:0@lo:400:kworker.0 00000100:00100000:2.0:1789297284.036113:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40cb7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957185792:0@lo:400:kworker.0 00010000:00080000:1.0:1789297284.043692:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b40943100 x1876213957186176/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297300 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297284.043736:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957186176:0@lo:400:kworker.0 00000100:00100000:3.0:1789297284.048000:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297284.048462:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933034112 00000100:00100000:1.0:1789297284.048473:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933034112 00000100:00100000:1.0:1789297284.048544:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:1.0:1789297284.048556:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+11:9708:x1876213933034112:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:1.0:1789297284.048583:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297284.048603:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b5c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8e4 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.048695:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b5cb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.048749:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.048763:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297284.048801:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789297284.048805:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297284.048846:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b5cb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.048871:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b5c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8e4 expref: 13 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.048890:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b5cb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8e4 expref: 12 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.048900:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:1.0:1789297284.048902:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789297284.048906:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3a00, rc 0) 00000100:00100000:1.0:1789297284.048995:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+12:9708:x1876213933034112:12345-192.168.202.43@tcp:101:rm.0 Request processed in 441us (1005us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297284.049002:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:1.0:1789297284.059513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297284.059607:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933034368 00000100:00100000:0.0:1789297284.059619:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933034368 00000100:00100000:0.0:1789297284.059680:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789297284.059689:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+12:9708:x1876213933034368:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:0.0:1789297284.059743:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297284.059765:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b5d2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8eb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297284.059868:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:0.0:1789297284.060083:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b5d2 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8eb expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.060099:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b15d3ab00) 00010000:00010000:0.0:1789297284.060108:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297284.060114:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b5d2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8eb expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.060131:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb400, rc 0) 00000100:00100000:0.0:1789297284.060373:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38290000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+13:9708:x1876213933034368:12345-192.168.202.43@tcp:101:rm.0 Request processed in 684us (870us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1789297284.060381:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789297284.064208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297284.064289:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933034496 00000100:00100000:3.0:1789297284.064300:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933034496 00000100:00100000:3.0:1789297284.064361:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:3.0:1789297284.064371:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:9708:x1876213933034496:12345-192.168.202.43@tcp:37:rm.0 00000100:00100000:0.0:1789297284.069946:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:9708:x1876213933034496:12345-192.168.202.43@tcp:37:rm.0 Request processed in 5562us (5736us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297284.069961:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789297284.074580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297284.075021:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933034752 00000100:00100000:2.0:1789297284.075032:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933034752 00000100:00100000:2.0:1789297284.075344:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789297284.075369:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13011450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+13:9708:x1876213933034752:12345-192.168.202.43@tcp:35:rm.0 00000100:00100000:2.0:1789297284.075652:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13011450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:9708:x1876213933034752:12345-192.168.202.43@tcp:35:rm.0 Request processed in 287us (1082us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789297284.075660:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:3.0:1789297284.078425:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297284.078658:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933035008 00000100:00100000:1.0:1789297284.078669:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933035008 00000100:00100000:1.0:1789297284.078754:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:1.0:1789297284.078765:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:9708:x1876213933035008:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:1.0:1789297284.078793:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297284.078815:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0b5e0 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8f2 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.078918:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3e00/0x8ad177e823a0b5e7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.078941:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3e00/0x8ad177e823a0b5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.078954:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3e00/0x8ad177e823a0b5e7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297284.078966:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:1.0:1789297284.079109:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0b5e0 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8f2 expref: 17 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.079126:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3e00/0x8ad177e823a0b5e7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8f2 expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297284.079134:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:1.0:1789297284.079137:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789297284.079140:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3e00, rc 0) 00000100:00100000:1.0:1789297284.079208:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+16:9708:x1876213933035008:12345-192.168.202.43@tcp:101:rm.0 Request processed in 445us (795us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1789297284.079231:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:3.0:1789297284.083868:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297284.084198:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933035136 00000100:00100000:2.0:1789297284.084209:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933035136 00000100:00100000:2.0:1789297284.084318:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:2.0:1789297284.084329:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+16:9708:x1876213933035136:12345-192.168.202.43@tcp:41:rm.0 00000004:00000024:2.0:1789297284.084403:0:5843:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1789297284.084475:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+16:9708:x1876213933035136:12345-192.168.202.43@tcp:41:rm.0 Request processed in 148us (618us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297284.084482:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:1.0:1789297284.088584:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297284.088692:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933035264 00000100:00100000:3.0:1789297284.088790:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933035264 00000100:00100000:3.0:1789297284.088907:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:3.0:1789297284.088938:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+16:9708:x1876213933035264:12345-192.168.202.43@tcp:101:rm.0 00010000:00010000:3.0:1789297284.088963:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297284.088987:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b5f5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d8f9 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089074:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089090:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089101:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089137:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089145:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089152:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089701:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b60a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089749:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089758:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297284.089792:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:3.0:1789297284.089797:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297284.089822:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089836:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b60a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089844:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089851:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089873:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089880:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297284.089884:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089893:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089907:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:3.0:1789297284.089911:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297284.089916:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089921:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b5fc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.089996:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090004:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090009:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090013:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297284.090016:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090032:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090041:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff982b03073800) 00010000:00010000:3.0:1789297284.090142:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297284.090147:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090153:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a000/0x8ad177e823a0b603 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090195:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b400/0x8ad177e823a0b5f5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8f9 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090209:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b60a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8f9 expref: 17 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.090217:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b03073b00) 00010000:00010000:3.0:1789297284.090219:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297284.090221:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152be00, rc 0) 00000100:00100000:3.0:1789297284.090290:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38293480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+17:9708:x1876213933035264:12345-192.168.202.43@tcp:101:rm.0 Request processed in 1362us (1717us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297284.090298:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:3.0:1789297284.093967:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297284.094218:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933035520 00000100:00100000:0.0:1789297284.094229:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933035520 00000100:00100000:0.0:1789297284.094294:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:0.0:1789297284.094305:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+17:9708:x1876213933035520:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:0.0:1789297284.094375:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789297284.094403:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b60a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8f9 expref: 17 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094425:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b5b6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8dd expref: 16 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094437:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b03073b00) 00010000:00010000:0.0:1789297284.094458:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b5cb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8e4 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094484:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:0.0:1789297284.094488:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297284.094511:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094525:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094535:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094550:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094557:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094563:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094674:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094683:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.094691:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789297284.095496:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1789297284.095510:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 295969804910ns, next at 296969802142ns, rc = 0 00010000:00010000:0.0:1789297284.095581:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095594:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095603:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095610:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095617:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095623:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095643:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297284.095662:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095668:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095674:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095681:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297284.095685:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095693:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095743:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b15d3a500) 00010000:00010000:0.0:1789297284.095746:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789297284.095751:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095756:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb600/0x8ad177e823a0b61f lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095780:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095786:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095793:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095797:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297284.095800:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095806:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095813:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:0.0:1789297284.095816:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297284.095818:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297284.095824:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b611 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789297284.095846:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000090387036 reply state 00000000f46dee09 transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297284.095855:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789297284.095942:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+16:9708:x1876213933035520:12345-192.168.202.43@tcp:36:rm.0 Request processed in 1636us (1983us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789297284.095951:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00010000:00010000:3.0:1789297284.096528:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297284.096537:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.096544:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297284.096557:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.096564:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.096576:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff982b15d3a500) 00010000:00010000:3.0:1789297284.096578:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789297284.096581:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.096587:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b626 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.096605:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297284.096607:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297284.096609:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297284.099581:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.099602:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.099610:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.099616:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297284.099621:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.099629:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.099649:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xfd685d83 (ffff982b15d3ad00) 00010000:00010000:2.0:1789297284.099667:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297284.099673:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.099680:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b618 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xfd685d83 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297284.103108:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297284.103300:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933035776 00000100:00100000:0.0:1789297284.103313:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933035776 00000100:00100000:0.0:1789297284.103386:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:0.0:1789297284.103398:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+15:9708:x1876213933035776:12345-192.168.202.43@tcp:35:rm.0 00000100:00100000:0.0:1789297284.103638:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+16:9708:x1876213933035776:12345-192.168.202.43@tcp:35:rm.0 Request processed in 242us (540us total) trans 4294967307 rc 0/0 00000100:00100000:0.0:1789297284.103645:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:0.0:1789297284.106781:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297284.106923:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036032 00000100:00100000:2.0:1789297284.106940:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036032 00000100:00100000:2.0:1789297284.106994:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:2.0:1789297284.107005:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+16:9708:x1876213933036032:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:2.0:1789297284.107080:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:2.0:1789297284.107106:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3e00/0x8ad177e823a0b5e7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8f2 expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107127:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b585 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8cf expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107137:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85300) 00010000:00010000:2.0:1789297284.107163:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b546 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8c1 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107177:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b15d3ab00) 00010000:00010000:2.0:1789297284.107184:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789297284.107207:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107219:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107246:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107260:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107267:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107273:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107535:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107544:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.107550:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297284.108133:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789297284.108148:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108156:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108163:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108169:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297284.108179:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108187:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108197:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff982b2ac85000) 00010000:00010000:2.0:1789297284.108200:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:2.0:1789297284.108204:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108210:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b63b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108229:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108236:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108241:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108247:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297284.108250:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108255:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108263:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:2.0:1789297284.108266:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297284.108275:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297284.108281:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b62d lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297284.108294:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e7c6351b reply state 00000000e9e5b4fc transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297284.108302:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789297284.108406:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+15:9708:x1876213933036032:12345-192.168.202.43@tcp:36:rm.0 Request processed in 1401us (1633us total) trans 4294967308 rc 0/0 00000100:00100000:2.0:1789297284.108415:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00010000:00010000:3.0:1789297284.114731:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.114752:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.114761:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.114769:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297284.114775:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.114784:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.114830:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff982b2ac85f00) 00010000:00010000:3.0:1789297284.114834:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297284.114840:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297284.114847:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b634 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297284.543933:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957186304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297284.544030:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297284.544461:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186304 00000100:00100000:3.0:1789297284.544470:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186304 00000100:00100000:3.0:1789297284.544553:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789297284.544563:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957186304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297284.544587:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297284.544648:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957186304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (628us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297284.544656:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:1.0:1789297284.544742:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39c87480 x1876213957186304/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297300 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297284.544760:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957186304:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297284.605599:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297285.054936:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957186432:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297285.055005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297285.055077:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186432 00000100:00100000:3.0:1789297285.055084:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186432 00000100:00100000:3.0:1789297285.055128:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:3.0:1789297285.055137:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957186432:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297285.055170:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297285.055213:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957186432:12345-0@lo:13:osp-pre-0-0.0 Request processed in 77us (208us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297285.055219:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:3.0:1789297285.055259:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b39c87480 x1876213957186432/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297301 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297285.055290:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c87480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957186432:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789297285.629813:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297286.641680:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297286.641749:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297286.641775:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297286.641823:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036288 00000100:00100000:0.0:1789297286.641833:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036288 00000100:00100000:0.0:1789297286.641890:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036544 00000100:00100000:0.0:1789297286.641894:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036544 00000100:00100000:0.0:1789297286.641924:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:0.0:1789297286.641934:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:2355:x1876213933036288:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297286.642014:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:2355:x1876213933036288:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 82us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297286.642032:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:0.0:1789297286.642051:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:0.0:1789297286.642058:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933036544:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297286.642087:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933036544:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 30us (311us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297286.642092:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00080000:0.0:1789297286.642108:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297286.644816:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036160 00000100:00100000:3.0:1789297286.644832:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036160 00000100:00100000:3.0:1789297286.644901:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 248 00000100:00100000:3.0:1789297286.644910:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933036160:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297286.644998:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933036160:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 88us (3329us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297286.645006:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 248 00000100:00100000:0.0:1789297286.646658:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297286.646837:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036416 00000100:00100000:2.0:1789297286.646846:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036416 00000100:00100000:2.0:1789297286.646918:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:2.0:1789297286.646929:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2356:x1876213933036416:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297286.647007:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2356:x1876213933036416:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 80us (357us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297286.647013:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00080000:0.0:1789297286.647244:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1789297286.656414:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297287.677021:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789297288.513737:0:11628:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:3.0:1789297288.705384:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297289.157391:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957186560:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157469:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297289.157513:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957187072:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157538:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297289.157564:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789297289.157570:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957186688:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157588:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297289.157602:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957187200:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157621:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297289.157645:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957186816:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157662:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297289.157677:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297289.157681:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957186944:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157696:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297289.157739:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186560 00000100:00100000:0.0:1789297289.157752:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186560 00000100:00100000:0.0:1789297289.157795:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789297289.157804:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957186560:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157850:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957186560:12345-0@lo:400:kworker.0 Request processed in 47us (381us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297289.157857:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 249 00000100:00100000:0.0:1789297289.157886:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957187072 00000100:00100000:0.0:1789297289.157889:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957187072 00000100:00100000:0.0:1789297289.157917:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186688 00000100:00100000:0.0:1789297289.157920:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186688 00000100:00100000:0.0:1789297289.157928:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186816 00000100:00100000:0.0:1789297289.157930:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186816 00000100:00100000:0.0:1789297289.157946:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789297289.157951:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957187072:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.157977:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957187072:12345-0@lo:400:kworker.0 Request processed in 26us (439us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297289.157983:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789297289.157993:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789297289.157997:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957186688:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.158344:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957186688:12345-0@lo:400:kworker.0 Request processed in 345us (753us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297289.158351:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1789297289.158367:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789297289.158374:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957186816:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.158405:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957186816:12345-0@lo:400:kworker.0 Request processed in 32us (741us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297289.158410:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:0.0:1789297289.158440:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957187200 00000100:00100000:0.0:1789297289.158443:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957187200 00000100:00100000:0.0:1789297289.158472:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957186944 00000100:00100000:0.0:1789297289.158475:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957186944 00000100:00100000:0.0:1789297289.158492:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789297289.158497:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957187200:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.158530:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957187200:12345-0@lo:400:kworker.0 Request processed in 32us (907us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297289.158535:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789297289.158546:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789297289.158551:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957186944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.158575:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957186944:12345-0@lo:400:kworker.0 Request processed in 24us (877us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297289.158581:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00080000:0.0:1789297289.158604:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789297289.158607:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789297289.158610:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789297289.158953:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b0621f480 x1876213957186944/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297289.158968:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957186944:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.158983:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957186816:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.160933:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957186688:0@lo:400:kworker.0 00010000:00080000:0.0:1789297289.160952:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b0621c000 x1876213957187200/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297305 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297289.160963:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957187200:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.160984:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957186560:0@lo:400:kworker.0 00000100:00100000:0.0:1789297289.160997:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957187072:0@lo:400:kworker.0 00000001:00080000:3.0:1789297289.204622:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967307 is committed 00000004:00080000:3.0:1789297289.204642:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1789297289.204664:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:2.0:1789297289.204907:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957187328:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789297289.204981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297289.205154:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957187328 00000100:00100000:2.0:1789297289.205163:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957187328 00000100:00100000:2.0:1789297289.205211:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789297289.205221:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957187328:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789297289.205263:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:2.0:1789297289.205306:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6aa68284, atime: 0x6aa68284, ctime: 0x6aa68284, blocks: 0x1 00010000:00010000:2.0:1789297289.205316:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.205333:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=301s v=(0 0) 00010000:00010000:2.0:1789297289.205337:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297289.205344:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.205360:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.205370:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.205378:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.205396:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789297289.206302:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3304:x1876213957187328:12345-0@lo:6:osp-syn-1-0.0 Request processed in 1080us (1318us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789297289.206313:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1789297289.206344:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297289.206351:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.206374:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297289.206379:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.206389:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.206407:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.206414:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d234e70a/0x8ad177e823a0b642 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.206432:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297289.206434:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297289.206435:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789297289.206504:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b40943b80/2, rc 0, transno 4294967300 00000100:00100000:3.0:1789297289.206512:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957187328:0@lo:6:osp-syn-1-0.0 00000020:00000080:0.0:1789297289.580765:0:11679:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffe22335080 20000000:00000080:0.0:1789297289.580784:0:11679:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982b40ea3c00 uarg=0000000000000000 20000000:01000000:0.0:1789297289.580823:0:11679:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789297289.580830:0:11679:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:0.0:1789297289.580836:0:11679:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:2.0:1789297289.582060:0:11680:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:0.0:1789297289.582478:0:11679:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:0.0:1789297289.588531:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:0.0:1789297289.588894:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:0.0:1789297289.588960:0:11679:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:0.0:1789297289.588979:0:11679:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789297289.588999:0:11679:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589019:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589026:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589034:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589040:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589047:0:11679:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589063:0:11679:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589104:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589120:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 18 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.589134:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187456:0@lo:104: 00000100:00100000:0.0:1789297289.589205:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297289.589269:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589278:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 18 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.589298:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187584:0@lo:104: 00000100:00100000:0.0:1789297289.589321:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297289.589354:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589362:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 18 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.589369:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187712:0@lo:104: 00000100:00100000:0.0:1789297289.589393:0:11679:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297289.589412:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 12 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589433:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 12 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.589443:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187840:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297289.589659:0:11679:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297289.589668:0:11679:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 12 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.589677:0:11679:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187968:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297289.589770:0:11679:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297289.590100:0:5824:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1789297289.590115:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957187456 00000100:00100000:1.0:1789297289.590122:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957187456 00000100:00100000:1.0:1789297289.590175:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957187584 00000100:00100000:1.0:1789297289.590179:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957187584 00000100:00100000:1.0:1789297289.590191:0:5824:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957187712 00000100:00100000:1.0:1789297289.590194:0:5824:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957187712 00000100:00100000:1.0:1789297289.590208:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789297289.590217:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:11679:x1876213957187456:12345-0@lo:104: 00010000:00010000:1.0:1789297289.590231:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590302:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789297289.590308:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+5:11679:x1876213957187456:12345-0@lo:104: Request processed in 93us (1104us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.590315:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789297289.590334:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297289.590340:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:11679:x1876213957187584:12345-0@lo:104: 00010000:00010000:1.0:1789297289.590347:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590392:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:1.0:1789297289.590398:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+4:11679:x1876213957187584:12345-0@lo:104: Request processed in 59us (1076us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.590403:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297289.590414:0:5824:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789297289.590420:0:5824:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b1fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:11679:x1876213957187712:12345-0@lo:104: 00010000:00010000:1.0:1789297289.590427:0:5824:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590459:0:5824:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:1.0:1789297289.590464:0:5824:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b1fe66850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+3:11679:x1876213957187712:12345-0@lo:104: Request processed in 45us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.590469:0:5824:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1789297289.590512:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1789297289.590519:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590526:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152ba00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297289.590530:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590538:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297289.590546:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297289.590552:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789297289.590859:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590867:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297289.590900:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590908:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152ba00/0x8ad177e823a0b50e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b515 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590924:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789297289.590927:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590932:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20062600 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297289.590934:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590940:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297289.590946:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297289.590951:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789297289.590965:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.590971:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297289.590986:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591003:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20062600/0x8ad177e823a0b500 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b507 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591013:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297289.591016:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591022:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20062000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297289.591025:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591032:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297289.591038:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297289.591043:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789297289.591056:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591062:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297289.591069:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591076:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20062000/0x8ad177e823a0b4f2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0b4f9 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591088:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297289.591095:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297289.591097:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297289.591106:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297289.591114:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297289.591130:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957188096:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297289.591170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297289.591214:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957188352:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297289.591252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297289.591274:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297289.591291:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957188224:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297289.591315:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297289.591343:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188096 00000100:00100000:1.0:1789297289.591349:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188096 00010000:00010000:1.0:1789297289.591370:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 19 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297289.591392:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188352 00000100:00100000:1.0:1789297289.591395:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188352 00010000:00010000:1.0:1789297289.591405:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 20 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297289.591414:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188224 00000100:00100000:1.0:1789297289.591416:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188224 00010000:00010000:1.0:1789297289.591425:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 21 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297289.591436:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789297289.591442:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3304:x1876213957188096:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297289.591452:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297289.591457:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 21 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591475:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 21 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591491:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297289.591521:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+21:3304:x1876213957188096:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.591528:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789297289.591542:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789297289.591548:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+20:3303:x1876213957188352:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297289.591555:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297289.591559:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 20 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591566:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 20 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.591576:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297289.592244:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42176800/0x8ad177e823a0b515 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b50e expref: 20 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.592258:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187456:0@lo:104: 00000100:00100000:0.0:1789297289.592269:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187584:0@lo:104: 00010000:00010000:0.0:1789297289.592277:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42177200/0x8ad177e823a0b4f9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b4f2 expref: 19 pid: 5837 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.592297:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187712:0@lo:104: 00000100:00100000:1.0:1789297289.592386:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcd500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:3303:x1876213957188352:12345-0@lo:103:ldlm_bl.0 Request processed in 837us (1131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.592393:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789297289.592409:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789297289.592418:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:3303:x1876213957188224:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297289.592428:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297289.592433:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 17 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.592444:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 17 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.592465:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42177600/0x8ad177e823a0b507 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0b500 expref: 17 pid: 5835 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.592474:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297289.592498:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3f450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:3303:x1876213957188224:12345-0@lo:103:ldlm_bl.0 Request processed in 83us (1182us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.592503:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789297289.592565:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38292a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957188096:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789297289.592749:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297289.592866:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38291500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957188224:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297289.592874:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38293100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957188352:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297289.593216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297289.593826:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036672 00000100:00100000:1.0:1789297289.593835:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036672 00010000:00010000:1.0:1789297289.593869:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 13 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297289.593909:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:1.0:1789297289.593918:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933036672:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297289.593930:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297289.593934:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 13 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.593945:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 13 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.593959:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297289.594002:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933036672:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 85us (788us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.594008:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:3.0:1789297289.594545:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297289.594662:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036800 00000100:00100000:1.0:1789297289.594679:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036800 00010000:00010000:1.0:1789297289.594698:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 13 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297289.594750:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:1.0:1789297289.594758:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933036800:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297289.594767:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297289.594771:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 13 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594780:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 13 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594795:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594803:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594819:0:5826:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594827:0:5826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594834:0:5826:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594841:0:5826:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594849:0:5826:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297289.594859:0:5826:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594868:0:5826:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594877:0:5826:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297289.594900:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297289.594982:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096c700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933036800:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 225us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297289.594990:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00010000:00010000:0.0:1789297289.595349:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42176e00/0x8ad177e823a0b4eb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8b3 expref: 12 pid: 5837 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.595371:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187840:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297289.596269:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063600/0x8ad177e823a0b4e4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d8ac expref: 11 pid: 5836 timeout: 401 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297289.596293:0:11679:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11679:1876213957187968:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297289.596327:0:11679:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.596338:0:11679:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.596354:0:11679:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297289.596360:0:11679:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059ba800/0x8ad177e823a0b649 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11679 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297289.661465:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789297289.661494:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957188480:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297289.661569:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297289.661646:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188480 00000100:00100000:0.0:1789297289.661655:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188480 00000100:00100000:0.0:1789297289.661724:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789297289.661733:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957188480:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297289.661775:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297289.661813:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957188480:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (245us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297289.661818:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789297289.661855:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957188480:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789297289.727745:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297290.173496:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957188608:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297290.173575:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297290.173798:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188608 00000100:00100000:3.0:1789297290.173808:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188608 00000100:00100000:3.0:1789297290.173858:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1789297290.173867:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957188608:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297290.173922:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297290.173982:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957188608:12345-0@lo:13:osp-pre-0-0.0 Request processed in 115us (406us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.173989:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00010000:00080000:1.0:1789297290.174142:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096ca80 x1876213957188608/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297306 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297290.174173:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957188608:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789297290.755009:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:0.0:1789297290.814742:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1789297290.814749:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982a01db8800 from 7 10000000:01000000:0.0:1789297290.814755:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789297290.814804:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297290.814817:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297290.814828:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297290.814886:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957188736:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789297290.814962:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297290.815049:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063afe40 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.815177:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188736 00000100:00100000:3.0:1789297290.815185:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188736 00000100:00100000:3.0:1789297290.815252:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:3.0:1789297290.815261:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:5839:x1876213957188736:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789297290.815307:0:5837:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297290.815322:0:5837:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152a000/0x8ad177e823a0b657 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b650 expref: -99 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297290.815345:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152a000/0x8ad177e823a0b657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b650 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297290.815355:0:5837:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152a000/0x8ad177e823a0b657 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b650 expref: 17 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297290.815364:0:5837:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a000, rc 0) 00000100:00100000:3.0:1789297290.815412:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957188736:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (449us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.815419:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00100000:1.0:1789297290.815753:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957188736:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297290.815770:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.815780:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297290.815836:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957188864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.815863:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297290.815901:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffcc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.816061:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188864 00000100:00100000:3.0:1789297290.816066:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188864 00000100:00100000:3.0:1789297290.816099:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 251 00000100:00100000:3.0:1789297290.816106:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957188864:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297290.816397:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957188864:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 290us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.816406:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 251 00000100:00100000:2.0:1789297290.818607:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcfb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957188864:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297290.818700:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957188992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297290.818826:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297290.818884:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b183953c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.819043:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957188992 00000100:00100000:3.0:1789297290.819050:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957188992 00000100:00100000:3.0:1789297290.819109:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:3.0:1789297290.819128:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957188992:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297290.819351:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957188992:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 224us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.819360:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1789297290.819460:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957188992:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297290.820092:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11692:1876213957189120:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297290.820136:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297290.820172:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789297290.820227:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957189120 00000100:00100000:1.0:1789297290.820232:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957189120 00000100:00100000:1.0:1789297290.820287:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1789297290.820296:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:11692:x1876213957189120:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297290.820470:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:11692:x1876213957189120:12345-0@lo:502:llog_process_th.0 Request processed in 176us (333us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297290.820480:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:2.0:1789297290.820565:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11692:1876213957189120:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789297290.820602:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297290.820612:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297290.820614:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789297290.820621:0:11692:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982a01db8800 00000020:00000080:2.0:1789297290.820623:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1789297290.823065:0:11692:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11692:1876213957189248:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297290.823156:0:11692:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297290.823207:0:11692:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789297290.829639:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957189248 00000100:00100000:1.0:1789297290.829659:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957189248 00000100:00100000:1.0:1789297290.829776:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:1.0:1789297290.829789:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:11692:x1876213957189248:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297290.830083:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:11692:x1876213957189248:12345-0@lo:502:llog_process_th.0 Request processed in 297us (6926us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297290.830092:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1789297290.830330:0:11692:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11692:1876213957189248:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789297290.830371:0:11692:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297290.830379:0:11692:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297290.830381:0:11692:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789297290.830385:0:11692:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789297290.830651:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789297290.830670:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789297290.830680:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.830693:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297290.830736:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789297290.830740:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b121d2000 from 7 10000000:01000000:1.0:1789297290.830743:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789297290.830779:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.830788:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.830810:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297290.830831:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957189376:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.831035:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297290.831074:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffa80 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.831123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957189376 00000100:00100000:3.0:1789297290.831129:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957189376 00000100:00100000:3.0:1789297290.831167:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1789297290.831176:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:5839:x1876213957189376:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789297290.831188:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297290.831202:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b665 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b65e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297290.831224:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b65e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297290.831234:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b665 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b65e expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297290.831242:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b400, rc 0) 00000100:00100000:3.0:1789297290.831293:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b051f7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957189376:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 118us (258us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.831299:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1789297290.831366:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcf100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957189376:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297290.831379:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297290.831388:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297290.831436:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957189504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297290.831463:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297290.831485:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.831531:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957189504 00000100:00100000:3.0:1789297290.831536:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957189504 00000100:00100000:3.0:1789297290.831568:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1789297290.831576:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957189504:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297290.831856:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957189504:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 280us (391us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.831992:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:2.0:1789297290.832084:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957189504:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297290.832113:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957189632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297290.832150:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297290.832167:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.832211:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957189632 00000100:00100000:3.0:1789297290.832215:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957189632 00000100:00100000:3.0:1789297290.832244:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789297290.832250:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957189632:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297290.832398:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957189632:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.832405:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:3.0:1789297290.832437:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f55c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957189632:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297290.832772:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11693:1876213957189760:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297290.832812:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297290.832884:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297290.843735:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957189760 00000100:00100000:2.0:1789297290.843751:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957189760 00000100:00100000:2.0:1789297290.843827:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:2.0:1789297290.843839:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:11693:x1876213957189760:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297290.844352:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:11693:x1876213957189760:12345-0@lo:502:llog_process_th.0 Request processed in 514us (11536us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297290.844361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:3.0:1789297290.851287:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11693:1876213957189760:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789297290.851351:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1789297290.851365:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297290.851367:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1789297290.851372:0:11693:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982b121d2000 00000020:00000080:3.0:1789297290.851375:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1789297290.851489:0:11693:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11693:1876213957189888:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297290.851822:0:11693:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297290.852059:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957189888 00000100:00100000:3.0:1789297290.852067:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957189888 00000100:00100000:3.0:1789297290.852130:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789297290.852141:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:11693:x1876213957189888:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297290.852405:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:11693:x1876213957189888:12345-0@lo:502:llog_process_th.0 Request processed in 267us (583us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.852416:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:3.0:1789297290.852465:0:11693:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.852483:0:11693:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096d500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11693:1876213957189888:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1789297290.852504:0:11693:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1789297290.852509:0:11693:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1789297290.852511:0:11693:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1789297290.852572:0:11693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:1.0:1789297290.854102:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:1.0:1789297290.854137:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789297290.854149:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.854161:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297290.854173:0:5839:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789297290.854175:0:5839:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b07359800 from 7 10000000:01000000:1.0:1789297290.854178:0:5839:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789297290.854218:0:5839:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.854226:0:5839:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.854237:0:5839:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297290.854261:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957190016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.854336:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297290.854404:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ff240 going to sleep for 11 seconds 00000100:00100000:0.0:1789297290.855513:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190016 00000100:00100000:0.0:1789297290.855526:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190016 00000100:00100000:0.0:1789297290.856946:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1789297290.857038:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:5839:x1876213957190016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297290.857062:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297290.857082:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b3e00/0x8ad177e823a0b673 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0b66c expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.857110:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b3e00/0x8ad177e823a0b673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0b66c expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.857122:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b3e00/0x8ad177e823a0b673 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0b66c expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297290.857130:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3e00, rc 0) 00000100:00100000:1.0:1789297290.857213:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957190016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 257us (2877us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297290.857221:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:0.0:1789297290.857641:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcdc00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957190016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297290.857662:0:5839:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297290.857671:0:5839:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297290.857783:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297290.857819:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297290.857850:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063afe40 going to sleep for 11 seconds 00000100:00100000:1.0:1789297290.858065:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190144 00000100:00100000:1.0:1789297290.858072:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190144 00000100:00100000:1.0:1789297290.858110:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789297290.858119:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957190144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.858409:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957190144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 291us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297290.858418:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000100:00100000:1.0:1789297290.858453:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621f800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957190144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.858485:0:5839:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957190272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.858528:0:5839:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297290.858548:0:5839:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297290.858567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190272 00000100:00100000:1.0:1789297290.858571:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190272 00000100:00100000:1.0:1789297290.858603:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789297290.858610:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957190272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.858787:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b121f2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:5839:x1876213957190272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 177us (261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297290.858794:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1789297290.858827:0:5839:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fced80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f5de263b-4dfd-46a5-a3a7-afaeb125f055:5839:1876213957190272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297290.864744:0:11696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11696:1876213957190400:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297290.864835:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297290.864896:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190400 00000100:00100000:1.0:1789297290.864902:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190400 00000100:00100000:1.0:1789297290.864946:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789297290.864955:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:11696:x1876213957190400:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297290.865180:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:11696:x1876213957190400:12345-0@lo:502:llog_process_th.0 Request processed in 226us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297290.865188:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:1.0:1789297290.865243:0:11696:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059ffcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297290.865265:0:11696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11696:1876213957190400:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789297290.865313:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789297290.865322:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297290.865324:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789297290.865331:0:11696:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982b07359800 00000020:00000080:1.0:1789297290.865334:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789297290.865773:0:11696:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11696:1876213957190528:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297290.865810:0:11696:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297290.865832:0:11696:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07ae8180 going to sleep for 11 seconds 00000100:00100000:3.0:1789297290.874112:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190528 00000100:00100000:3.0:1789297290.874126:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190528 00000100:00100000:3.0:1789297290.874184:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:3.0:1789297290.874193:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:11696:x1876213957190528:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297290.875048:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:11696:x1876213957190528:12345-0@lo:502:llog_process_th.0 Request processed in 852us (9232us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297290.875058:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1789297290.875205:0:11696:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fced80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f5de263b-4dfd-46a5-a3a7-afaeb125f055:11696:1876213957190528:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297290.875328:0:11696:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297290.875338:0:11696:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297290.875341:0:11696:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789297290.875346:0:11696:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:2.0:1789297290.875684:0:5839:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:2.0:1789297290.875873:0:5839:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789297290.875885:0:5839:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297290.875897:0:5839:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789297290.880859:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:3.0:1789297291.372006:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297291.373484:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933036928 00000100:00100000:1.0:1789297291.373498:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933036928 00000100:00100000:1.0:1789297291.373615:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 265 00000100:00100000:1.0:1789297291.373640:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:5598:x1876213933036928:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297291.373658:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297291.373675:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b3800/0x8ad177e823a0b67a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d900 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297291.373734:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b3800/0x8ad177e823a0b67a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d900 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297291.373745:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b3800/0x8ad177e823a0b67a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d900 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297291.373755:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3800, rc 0) 00000100:00100000:1.0:1789297291.373822:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933036928:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 199us (1837us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297291.373829:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 265 00000100:00100000:3.0:1789297291.379466:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297291.379590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037056 00000100:00100000:0.0:1789297291.379601:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037056 00000100:00100000:0.0:1789297291.379662:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 266 00000100:00100000:0.0:1789297291.379672:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933037056:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297291.380057:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933037056:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 385us (600us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297291.380075:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 266 00000100:00100000:3.0:1789297291.385098:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297291.385415:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037184 00000100:00100000:0.0:1789297291.385428:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037184 00000100:00100000:0.0:1789297291.385498:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 267 00000100:00100000:0.0:1789297291.385519:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933037184:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1789297291.385794:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933037184:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 287us (706us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297291.385802:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 267 00000100:00100000:3.0:1789297291.389174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297291.390789:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037312 00000100:00100000:1.0:1789297291.390803:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037312 00000100:00100000:1.0:1789297291.390932:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 268 00000100:00100000:1.0:1789297291.390945:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:9978:x1876213933037312:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789297291.393187:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:9978:x1876213933037312:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 2235us (4011us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297291.393202:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 268 00000100:00100000:2.0:1789297291.411783:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297291.411882:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037440 00000100:00100000:3.0:1789297291.411894:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037440 00000100:00100000:3.0:1789297291.411949:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 269 00000100:00100000:3.0:1789297291.411960:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:9978:x1876213933037440:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789297291.412324:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:9978:x1876213933037440:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 364us (551us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297291.412333:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 269 00000100:00100000:3.0:1789297291.425486:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297291.425790:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037568 00000100:00100000:1.0:1789297291.425804:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037568 00000100:00100000:1.0:1789297291.425885:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 270 00000100:00100000:1.0:1789297291.425897:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:5598:x1876213933037568:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297291.425917:0:5836:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297291.425938:0:5836:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b2a00/0x8ad177e823a0b681 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d907 expref: -99 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297291.425984:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b2a00/0x8ad177e823a0b681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d907 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297291.425996:0:5836:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b2a00/0x8ad177e823a0b681 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d907 expref: 13 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297291.426007:0:5836:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2a00, rc 0) 00000100:00100000:1.0:1789297291.426075:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933037568:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 181us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297291.426082:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 270 00000100:00100000:1.0:1789297291.433360:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297291.433454:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037696 00000100:00100000:0.0:1789297291.433465:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037696 00000100:00100000:0.0:1789297291.433523:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 271 00000100:00100000:0.0:1789297291.433533:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933037696:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297291.433992:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933037696:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 458us (640us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297291.434000:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 271 00000100:00100000:2.0:1789297291.439656:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297291.439748:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037824 00000100:00100000:3.0:1789297291.439762:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037824 00000100:00100000:3.0:1789297291.439829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 272 00000100:00100000:3.0:1789297291.439840:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933037824:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297291.440350:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:5598:x1876213933037824:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 509us (704us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297291.440359:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 272 00000100:00100000:3.0:1789297291.447482:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297291.448052:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933037952 00000100:00100000:1.0:1789297291.448065:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933037952 00000100:00100000:2.0:1789297291.450154:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 273 00000100:00100000:2.0:1789297291.450170:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:9981:x1876213933037952:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:2.0:1789297291.450608:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:9981:x1876213933037952:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 441us (3136us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297291.450618:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 273 00000100:00100000:1.0:1789297291.458743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297291.458831:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038080 00000100:00100000:0.0:1789297291.458842:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038080 00000100:00100000:0.0:1789297291.458901:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 274 00000100:00100000:0.0:1789297291.458912:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:9981:x1876213933038080:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297291.459196:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:9981:x1876213933038080:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 284us (503us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297291.459203:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 274 00000100:00100000:3.0:1789297291.756194:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297291.756239:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297291.756315:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297291.756363:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038208 00000100:00100000:0.0:1789297291.756375:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038208 00000100:00100000:1.0:1789297291.756413:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038464 00000100:00100000:1.0:1789297291.756420:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038464 00000100:00100000:0.0:1789297291.756461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:1.0:1789297291.756470:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 105 00000100:00100000:0.0:1789297291.756476:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933038208:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297291.756485:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933038464:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297291.756589:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933038464:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 108us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297291.756596:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 105 00000100:00100000:2.0:1789297291.757563:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038336 00000100:00100000:2.0:1789297291.757571:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038336 00000100:00100000:2.0:1789297291.757671:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:2.0:1789297291.757681:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933038336:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297291.759544:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933038208:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 3063us (3350us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297291.759559:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:2.0:1789297291.759587:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933038336:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 1904us (3272us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297291.759597:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00080000:0.0:1789297291.759598:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1789297291.759605:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1789297291.773144:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789297291.901515:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789297292.798305:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297293.823249:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297294.269147:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957191040:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.269226:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957190656:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.269296:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297294.269342:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957191168:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.269369:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297294.269405:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789297294.269411:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957190784:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.269431:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297294.269448:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957191296:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.269470:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297294.269786:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191168 00000100:00100000:0.0:1789297294.269794:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191168 00000100:00100000:0.0:1789297294.269844:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190784 00000100:00100000:0.0:1789297294.269847:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190784 00000100:00100000:0.0:1789297294.269871:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789297294.269879:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957191168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.269937:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957191168:12345-0@lo:400:kworker.0 Request processed in 57us (566us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297294.269960:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:0.0:1789297294.269977:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:0.0:1789297294.269991:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957190784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.270021:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957190784:12345-0@lo:400:kworker.0 Request processed in 31us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297294.270026:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00080000:0.0:1789297294.270047:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297294.270221:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957190784:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.270231:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957191168:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.271649:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297294.271742:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789297294.271755:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957190912:0@lo:400:kworker.0 00000100:00100000:0.0:1789297294.271790:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297294.271817:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190912 00000100:00100000:0.0:1789297294.271822:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190912 00000100:00100000:0.0:1789297294.271867:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789297294.271876:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957190912:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789297294.271899:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297294.271925:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957190912:12345-0@lo:400:kworker.0 Request processed in 50us (134us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297294.271932:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:0.0:1789297294.271965:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957190912:0@lo:400:kworker.0 00000100:00100000:2.0:1789297294.275149:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191296 00000100:00100000:2.0:1789297294.275165:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191296 00000100:00100000:1.0:1789297294.275218:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957190656 00000100:00100000:1.0:1789297294.275223:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957190656 00000100:00100000:2.0:1789297294.275230:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191040 00000100:00100000:2.0:1789297294.275249:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191040 00000100:00100000:2.0:1789297294.275271:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789297294.275273:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 275 00000100:00100000:2.0:1789297294.275282:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957191296:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297294.275282:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957190656:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297294.275998:0:6687:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789297294.276009:0:6687:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789297294.276108:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789297294.276119:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957191040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297294.276552:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957190656:12345-0@lo:400:kworker.0 Request processed in 1271us (7255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297294.276561:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 275 00000100:00100000:1.0:1789297294.276625:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957190656:0@lo:400:kworker.0 00000100:00080000:1.0:1789297294.276908:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789297294.276913:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789297294.284340:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957191296:12345-0@lo:400:kworker.0 Request processed in 9049us (14856us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297294.284357:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1789297294.284522:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fce300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957191296:0@lo:400:kworker.0 00000100:00100000:3.0:1789297294.290507:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957191040:12345-0@lo:400:kworker.0 Request processed in 14380us (18853us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297294.290524:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00010000:00080000:2.0:1789297294.291182:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11fcc380 x1876213957191040/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297310 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297294.291352:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957191040:0@lo:400:kworker.0 00000001:00080000:0.0:1789297294.436190:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000100:00100000:0.0:1789297294.781778:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789297294.781806:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957191424:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297294.781888:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297294.782178:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191424 00000100:00100000:1.0:1789297294.782186:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191424 00000100:00100000:1.0:1789297294.782289:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:1.0:1789297294.782300:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957191424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297294.782343:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297294.782408:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957191424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297294.782416:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1789297294.782484:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:3.0:1789297294.782492:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b40943b80, transno 4294967300 00000100:00100000:3.0:1789297294.782524:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957191424:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789297294.848569:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297295.296278:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297295.296302:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957191552:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297295.296376:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297295.298169:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191552 00000100:00100000:1.0:1789297295.298184:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191552 00000100:00100000:1.0:1789297295.298289:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1789297295.298300:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957191552:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297295.298350:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297295.298440:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957191552:12345-0@lo:13:osp-pre-0-0.0 Request processed in 142us (2062us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297295.298467:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00010000:00080000:2.0:1789297295.298488:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096ca80 x1876213957191552/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297311 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297295.298509:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957191552:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789297295.871911:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297296.876390:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297296.876433:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297296.876481:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297296.876520:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297296.876551:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038720 00000100:00100000:1.0:1789297296.876553:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038976 00000100:00100000:2.0:1789297296.876565:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038720 00000100:00100000:1.0:1789297296.876565:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038976 00000100:00100000:3.0:1789297296.876628:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038592 00000100:00100000:3.0:1789297296.876633:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038592 00000100:00100000:3.0:1789297296.876679:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 276 00000100:00100000:3.0:1789297296.876742:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933038592:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297296.876825:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933038592:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 123us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297296.876832:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 276 00000100:00100000:0.0:1789297296.877047:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933038848 00000100:00100000:0.0:1789297296.877053:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933038848 00000100:00100000:1.0:1789297296.877060:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 109 00000100:00100000:1.0:1789297296.877147:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933038976:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297296.877265:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933038976:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 197us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297296.877273:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 109 00000100:00100000:2.0:1789297296.878492:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 110 00000100:00100000:2.0:1789297296.878503:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933038720:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297296.878565:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933038720:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 63us (2083us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297296.878574:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 110 00000100:00080000:3.0:1789297296.886959:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297296.886969:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297296.890528:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:0.0:1789297296.890566:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933038848:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297296.890660:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933038848:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 102us (14226us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297296.890668:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00010000:00010000:1.0:1789297296.893326:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297297.917647:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297298.941311:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297299.392117:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957191680:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.392217:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297299.392275:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957192192:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.392310:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297299.392341:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789297299.392420:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957191808:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.392445:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297299.392469:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957192320:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.392492:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297299.392527:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957191936:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.392556:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297299.392580:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297299.392587:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957192064:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.392611:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297299.392632:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192192 00000100:00100000:2.0:1789297299.392643:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192192 00000100:00100000:0.0:1789297299.392644:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192320 00000100:00100000:0.0:1789297299.392650:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192320 00000100:00100000:2.0:1789297299.392743:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191808 00000100:00100000:2.0:1789297299.392747:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191808 00000100:00100000:2.0:1789297299.392761:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191936 00000100:00100000:2.0:1789297299.392764:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191936 00000100:00100000:0.0:1789297299.393477:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192064 00000100:00100000:0.0:1789297299.393486:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192064 00000100:00100000:0.0:1789297299.393517:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789297299.393527:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957192320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.393597:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957192320:12345-0@lo:400:kworker.0 Request processed in 71us (1103us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297299.393614:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1789297299.393630:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789297299.393637:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957192064:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.393670:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120af100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957192064:12345-0@lo:400:kworker.0 Request processed in 33us (1057us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297299.393676:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1789297299.393699:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789297299.393722:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957192192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.393752:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120aea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957192192:12345-0@lo:400:kworker.0 Request processed in 32us (1441us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297299.393758:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:0.0:1789297299.393771:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789297299.393777:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957191808:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297299.394328:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789297299.394339:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957191936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297299.394387:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120afb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957191936:12345-0@lo:400:kworker.0 Request processed in 51us (1831us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297299.394394:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1789297299.394422:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957191680 00000100:00100000:2.0:1789297299.394427:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957191680 00000100:00100000:0.0:1789297299.394456:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957191808:12345-0@lo:400:kworker.0 Request processed in 676us (2007us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297299.394461:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 277 00000100:00100000:0.0:1789297299.394469:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1789297299.394475:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957191680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297299.394518:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957191680:12345-0@lo:400:kworker.0 Request processed in 47us (2302us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297299.394525:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 277 00010000:00080000:0.0:1789297299.394534:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b0621c700 x1876213957192064/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297315 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297299.394553:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957192064:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.394569:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957191936:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.394607:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957191808:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.394621:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957192320:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.394632:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957191680:0@lo:400:kworker.0 00000100:00100000:0.0:1789297299.394655:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957192192:0@lo:400:kworker.0 00000100:00080000:2.0:1789297299.394901:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789297299.394906:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297299.394909:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297299.913589:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789297299.913690:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957192448:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297299.913779:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297299.913930:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192448 00000100:00100000:0.0:1789297299.913939:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192448 00000100:00100000:0.0:1789297299.913999:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1789297299.914009:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957192448:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297299.914049:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297299.914103:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957192448:12345-0@lo:13:osp-pre-1-0.0 Request processed in 96us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297299.914110:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1789297299.914214:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957192448:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297299.974237:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297300.413334:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297300.413358:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957192576:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297300.413497:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297300.413720:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192576 00000100:00100000:0.0:1789297300.413730:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192576 00000100:00100000:0.0:1789297300.413784:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789297300.413794:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957192576:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297300.413832:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297300.413896:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcc000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957192576:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297300.413904:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:2.0:1789297300.414098:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096ca80 x1876213957192576/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297316 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297300.414117:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957192576:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1789297300.988881:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789297301.119951:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789297301.997174:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297301.997278:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297302.002382:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297302.002440:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297302.002489:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933039360 00000100:00100000:1.0:1789297302.002500:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933039360 00000100:00100000:1.0:1789297302.002567:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:1.0:1789297302.002583:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933039360:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297302.002652:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933039360:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 77us (212us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297302.002673:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00080000:1.0:1789297302.002695:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297302.002869:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933039104 00000100:00100000:0.0:1789297302.002874:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933039104 00000100:00100000:0.0:1789297302.002908:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 278 00000100:00100000:0.0:1789297302.002914:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933039104:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297302.002944:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933039104:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 30us (573us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297302.002950:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 278 00000100:00100000:2.0:1789297302.005653:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933039232 00000100:00100000:2.0:1789297302.005669:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933039232 00000100:00100000:3.0:1789297302.011621:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933039488 00000100:00100000:3.0:1789297302.011638:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933039488 00000100:00100000:3.0:1789297302.011991:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:3.0:1789297302.012014:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933039488:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297302.012098:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933039488:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 98us (14820us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297302.012105:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00080000:1.0:1789297302.012269:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297302.015051:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:0.0:1789297302.015078:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933039232:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297302.015926:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933039232:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 858us (18769us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297302.015937:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 115 00010000:00010000:1.0:1789297302.022950:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297303.037224:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297304.061457:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297304.511384:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957192704:0@lo:400:kworker.0 00000100:00100000:0.0:1789297304.511494:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297304.511546:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957193216:0@lo:400:kworker.0 00000100:00100000:0.0:1789297304.511576:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297304.511603:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1789297304.511609:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957192832:0@lo:400:kworker.0 00000100:00100000:0.0:1789297304.511631:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297304.511646:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957193344:0@lo:400:kworker.0 00000100:00100000:0.0:1789297304.511668:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297304.511722:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193344 00000100:00100000:0.0:1789297304.511731:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193344 00000100:00100000:0.0:1789297304.511804:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789297304.511814:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957193344:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297304.511866:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957193344:12345-0@lo:400:kworker.0 Request processed in 53us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297304.511873:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:0.0:1789297304.511927:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957193344:0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515234:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957192960:0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515324:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297304.515375:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297304.515383:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957193088:0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515407:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297304.515446:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192704 00000100:00100000:2.0:1789297304.515455:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192704 00000100:00100000:2.0:1789297304.515504:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789297304.515513:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957192704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957192704:12345-0@lo:400:kworker.0 Request processed in 61us (4109us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297304.515581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:2.0:1789297304.515613:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193216 00000100:00100000:2.0:1789297304.515618:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193216 00000100:00100000:2.0:1789297304.515649:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192832 00000100:00100000:2.0:1789297304.515653:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192832 00000100:00100000:2.0:1789297304.515664:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957192960 00000100:00100000:2.0:1789297304.515666:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957192960 00000100:00100000:2.0:1789297304.515680:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789297304.515686:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957193216:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515762:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957193216:12345-0@lo:400:kworker.0 Request processed in 64us (4174us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297304.515769:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:2.0:1789297304.515781:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789297304.515796:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957192832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515840:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957192832:12345-0@lo:400:kworker.0 Request processed in 45us (4208us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297304.515846:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:2.0:1789297304.515858:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789297304.515864:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957192960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515895:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957192960:12345-0@lo:400:kworker.0 Request processed in 31us (570us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297304.515900:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:2.0:1789297304.515938:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120adf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957192960:0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515968:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957192832:0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.515978:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957192704:0@lo:400:kworker.0 00000100:00100000:2.0:1789297304.516375:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957193216:0@lo:400:kworker.0 00000100:00080000:1.0:1789297304.516648:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789297304.516654:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297304.517284:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193088 00000100:00100000:1.0:1789297304.517302:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193088 00000100:00100000:1.0:1789297304.517351:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789297304.517365:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957193088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297304.517447:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957193088:12345-0@lo:400:kworker.0 Request processed in 88us (2037us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297304.517454:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00080000:1.0:1789297304.517500:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b120af800 x1876213957193088/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297320 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297304.517514:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957193088:0@lo:400:kworker.0 00000100:00080000:0.0:1789297304.519250:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297305.021047:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957193472:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297305.021173:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297305.021298:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193472 00000100:00100000:3.0:1789297305.021308:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193472 00000100:00100000:3.0:1789297305.021370:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1789297305.021381:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957193472:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297305.021438:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297305.026677:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957193472:12345-0@lo:13:osp-pre-1-0.0 Request processed in 5286us (5491us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297305.026693:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789297305.035627:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957193472:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297305.092720:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297305.534058:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297305.534087:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957193600:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297305.534180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297305.537609:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193600 00000100:00100000:3.0:1789297305.537629:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193600 00000100:00100000:3.0:1789297305.537753:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1789297305.537781:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957193600:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297305.537831:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297305.537924:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957193600:12345-0@lo:13:osp-pre-0-0.0 Request processed in 146us (3745us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297305.537931:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00010000:00080000:1.0:1789297305.538904:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b4096ca80 x1876213957193600/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297321 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297305.538951:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b4096ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957193600:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789297306.109245:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297307.115840:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297307.116020:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933039616 00000100:00100000:2.0:1789297307.116030:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933039616 00000100:00100000:2.0:1789297307.116097:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 280 00000100:00100000:2.0:1789297307.116108:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933039616:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297307.116200:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933039616:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 93us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297307.116207:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 280 00000100:00100000:2.0:1789297307.132600:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297307.132989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933039744 00000100:00100000:0.0:1789297307.132998:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933039744 00000100:00100000:0.0:1789297307.133133:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:0.0:1789297307.133145:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933039744:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297307.133243:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933039744:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 100us (654us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297307.133251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 119 00010000:00010000:3.0:1789297307.133995:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297307.140764:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297307.141241:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297307.141341:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933040000 00000100:00100000:2.0:1789297307.141351:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933040000 00000100:00080000:1.0:1789297307.141435:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297307.143500:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:2.0:1789297307.143515:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933040000:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297307.143620:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120af480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933040000:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 108us (2866us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297307.143768:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933039872 00000100:00100000:3.0:1789297307.143775:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933039872 00000100:00080000:0.0:1789297307.145377:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789297307.145419:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:3.0:1789297307.147652:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789297307.147678:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2352:x1876213933039872:12345-192.168.202.43@tcp:9:kworker.0 00000020:00000080:3.0:1789297307.147741:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b5bd 00000100:00080000:3.0:1789297307.147753:0:6689:0:(import.c:65:import_set_state_nolock()) ffff982b40a2f000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789297307.147807:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:3.0:1789297307.148093:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+2:2352:x1876213933039872:12345-192.168.202.43@tcp:9:kworker.0 Request processed in 428us (6852us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297307.148101:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00010000:00010000:2.0:1789297307.148442:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297308.157115:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297309.181300:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297309.632053:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957193856:0@lo:400:kworker.0 00000100:00100000:3.0:1789297309.632161:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297309.632240:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297309.632247:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957193728:0@lo:400:kworker.0 00000100:00100000:3.0:1789297309.632276:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297309.632314:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193856 00000100:00100000:3.0:1789297309.632324:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193856 00000100:00100000:3.0:1789297309.632377:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789297309.632387:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957193856:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297309.632464:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957193856:12345-0@lo:400:kworker.0 Request processed in 77us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297309.632472:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 121 00000100:00100000:3.0:1789297309.632539:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957193856:0@lo:400:kworker.0 00000100:00100000:1.0:1789297309.633290:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957193984:0@lo:400:kworker.0 00000100:00100000:1.0:1789297309.633332:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297309.633359:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297309.633364:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957194112:0@lo:400:kworker.0 00000100:00100000:1.0:1789297309.633388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297309.633413:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193984 00000100:00100000:1.0:1789297309.633419:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193984 00000100:00100000:1.0:1789297309.633465:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789297309.633481:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957193984:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297309.633526:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957193984:12345-0@lo:400:kworker.0 Request processed in 53us (192us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297309.633533:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1789297309.633555:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957194112 00000100:00100000:1.0:1789297309.633559:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957194112 00000100:00100000:1.0:1789297309.633589:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789297309.633597:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957194112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297309.633633:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957194112:12345-0@lo:400:kworker.0 Request processed in 38us (243us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297309.633653:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:1.0:1789297309.633673:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789297309.633678:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789297309.633740:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b120ace00 x1876213957194112/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297325 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297309.633776:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957194112:0@lo:400:kworker.0 00000100:00100000:1.0:1789297309.633792:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957193984:0@lo:400:kworker.0 00000100:00100000:2.0:1789297309.634216:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957194240:0@lo:400:kworker.0 00000100:00100000:2.0:1789297309.634262:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297309.634293:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789297309.634300:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957194368:0@lo:400:kworker.0 00000100:00100000:2.0:1789297309.634325:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297309.634357:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957193728 00000100:00100000:2.0:1789297309.634362:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957193728 00000100:00100000:2.0:1789297309.634399:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789297309.634407:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957193728:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297309.634446:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957193728:12345-0@lo:400:kworker.0 Request processed in 39us (2168us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297309.634453:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1789297309.634488:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957194240 00000100:00100000:2.0:1789297309.634491:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957194240 00000100:00100000:2.0:1789297309.634524:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:2.0:1789297309.634531:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957194240:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297309.634569:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957194240:12345-0@lo:400:kworker.0 Request processed in 38us (306us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297309.634575:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00080000:2.0:1789297309.634603:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297309.634628:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120adc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957194240:0@lo:400:kworker.0 00000100:00100000:3.0:1789297309.635658:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957194368 00000100:00100000:3.0:1789297309.635668:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957194368 00000100:00100000:3.0:1789297309.635788:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1789297309.635798:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957194368:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297309.636408:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ac000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957193728:0@lo:400:kworker.0 00000100:00080000:0.0:1789297309.636450:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789297309.638654:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957194368:12345-0@lo:400:kworker.0 Request processed in 2844us (4314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297309.638674:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789297309.638996:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957194368:0@lo:400:kworker.0 00000001:00100000:2.0:1789297309.702858:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:2.0:1789297309.702889:0:7644:0:(genops.c:885:class_export_put()) final put ffff982b40a2c800/235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:2.0:1789297309.702925:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982b40a2c800/235dd3df-f928-4719-bb69-fc817cc2744f for lustre-OST0001 00000020:00000080:2.0:1789297309.702987:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b40a2f000 for lustre-OST0001 00000100:00100000:0.0:1789297310.140985:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789297310.141020:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957194496:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297310.141140:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297310.141251:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957194496 00000100:00100000:0.0:1789297310.141260:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957194496 00000100:00100000:0.0:1789297310.141324:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789297310.141336:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957194496:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297310.141386:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297310.141455:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ac000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957194496:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297310.141464:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789297310.141525:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957194496:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789297310.208539:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297310.653197:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297310.653242:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957194624:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297310.653347:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297310.653435:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957194624 00000100:00100000:1.0:1789297310.653445:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957194624 00000100:00100000:1.0:1789297310.653512:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1789297310.653523:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957194624:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297310.653573:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297310.653623:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957194624:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (275us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297310.653631:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00010000:00080000:1.0:1789297310.653684:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11fcc700 x1876213957194624/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297326 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297310.653735:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcc700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957194624:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789297311.232468:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789297311.364209:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1789297312.236435:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297312.236481:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297312.236496:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933040128 00000100:00100000:3.0:1789297312.236510:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933040128 00000100:00100000:1.0:1789297312.236526:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297312.236607:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933040384 00000100:00100000:2.0:1789297312.236612:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933040384 00000100:00100000:3.0:1789297312.236726:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 282 00000100:00100000:2.0:1789297312.236727:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933040256 00000100:00100000:2.0:1789297312.236732:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933040256 00000100:00100000:3.0:1789297312.236741:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933040128:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297312.236766:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:2.0:1789297312.236776:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933040384:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297312.236853:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933040128:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 115us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297312.236854:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2354:x1876213933040384:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 79us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297312.236873:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 282 00000100:00100000:2.0:1789297312.236874:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:2.0:1789297312.236904:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:2.0:1789297312.236917:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933040256:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297312.236947:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933040256:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297312.236953:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00080000:1.0:1789297312.237264:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789297312.253482:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297313.283039:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789297314.238576:0:11860:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 07:01:52 (1789297312) 00010000:00010000:1.0:1789297314.301178:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297314.750414:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957194752:0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.750513:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957195008:0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.750513:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297314.750566:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297314.750575:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957195264:0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.750599:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297314.750599:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297314.750605:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957195136:0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.750616:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1789297314.750622:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957194880:0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.750632:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297314.750653:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297314.750673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957194752 00000100:00100000:3.0:1789297314.750683:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957194752 00000100:00100000:2.0:1789297314.750684:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957195392:0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.750727:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297314.750760:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957195008 00000100:00100000:2.0:1789297314.750764:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957195008 00000100:00100000:2.0:1789297314.750812:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957195264 00000100:00100000:2.0:1789297314.750814:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957195264 00000100:00100000:3.0:1789297314.750817:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1789297314.750827:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957194752:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.750834:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957194880 00000100:00100000:2.0:1789297314.750836:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957194880 00000100:00100000:2.0:1789297314.750847:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789297314.750853:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957195008:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.750887:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3302:x1876213957194752:12345-0@lo:400:kworker.0 Request processed in 60us (373us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297314.750887:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957195008:12345-0@lo:400:kworker.0 Request processed in 33us (319us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297314.750895:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:2.0:1789297314.750895:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 126 00000100:00100000:2.0:1789297314.750913:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789297314.750919:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957195264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.750948:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957195264:12345-0@lo:400:kworker.0 Request processed in 28us (347us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297314.750954:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:2.0:1789297314.750966:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:2.0:1789297314.750972:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957194880:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.750998:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957194880:12345-0@lo:400:kworker.0 Request processed in 26us (345us total) trans 0 rc 0/0 00000100:00080000:3.0:1789297314.751005:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297314.751005:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1789297314.751020:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957195136 00000100:00100000:3.0:1789297314.751024:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957195136 00000100:00100000:2.0:1789297314.751061:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059cbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957195008:0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.751067:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957195392 00000100:00100000:3.0:1789297314.751070:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957195392 00000100:00100000:3.0:1789297314.751090:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789297314.751094:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059c9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957194880:0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.751097:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957195136:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.751111:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059ca680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957194752:0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.751122:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059c9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957195264:0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.751131:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957195136:12345-0@lo:400:kworker.0 Request processed in 36us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297314.751137:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789297314.751148:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00010000:00080000:2.0:1789297314.751150:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b059cb100 x1876213957195136/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1789297330 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297314.751155:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957195392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297314.751161:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059cb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957195136:0@lo:400:kworker.0 00000100:00100000:3.0:1789297314.751191:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957195392:12345-0@lo:400:kworker.0 Request processed in 37us (463us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297314.751197:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789297314.751200:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059cad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957195392:0@lo:400:kworker.0 00000100:00080000:2.0:1789297314.751847:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297314.751851:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297315.261243:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297315.261505:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957195520:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297315.261618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297315.262295:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957195520 00000100:00100000:1.0:1789297315.262309:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957195520 00000100:00100000:1.0:1789297315.262519:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1789297315.262532:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957195520:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297315.262798:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297315.263020:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957195520:12345-0@lo:13:osp-pre-1-0.0 Request processed in 491us (1402us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297315.263029:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789297315.263142:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120aed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957195520:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297315.325456:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297315.773078:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297315.773113:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957195648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297315.773212:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297315.773571:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957195648 00000100:00100000:0.0:1789297315.773582:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957195648 00000100:00100000:0.0:1789297315.773679:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1789297315.773691:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957195648:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297315.773783:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297315.773853:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957195648:12345-0@lo:13:osp-pre-0-0.0 Request processed in 165us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297315.773861:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00010000:00080000:2.0:1789297315.774003:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b11fcdc00 x1876213957195648/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297331 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297315.774027:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957195648:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297315.927409:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297315.927532:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933040512 00000100:00100000:3.0:1789297315.927549:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933040512 00000100:00100000:3.0:1789297315.927659:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:3.0:1789297315.927735:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:10252:x1876213933040512:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297315.927777:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297315.927811:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b688 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d90e expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.927903:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0b68f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.927922:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0b68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.927940:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0b68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297315.927993:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789297315.927997:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297315.928060:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0b68f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.928095:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b688 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d90e expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.928118:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0b68f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d90e expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.928129:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073000) 00010000:00010000:3.0:1789297315.928132:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297315.928136:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152aa00, rc 0) 00000100:00100000:3.0:1789297315.928220:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:10252:x1876213933040512:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 529us (828us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297315.928239:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00080000:2.0:1789297315.928947:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297315.948700:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297315.948939:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933040640 00000100:00100000:3.0:1789297315.948954:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933040640 00000100:00100000:3.0:1789297315.949057:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:3.0:1789297315.949071:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:10253:x1876213933040640:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297315.949102:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297315.949135:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b696 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d915 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949227:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949246:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949260:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949279:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949286:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949293:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949595:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b6ab lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949618:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b6ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949625:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b6ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297315.949679:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789297315.949684:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297315.949747:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b6ab lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949774:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949781:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949789:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949796:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297315.949801:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949809:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949824:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073000) 00010000:00010000:3.0:1789297315.949828:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297315.949832:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949852:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b69d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949868:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949874:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949880:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949886:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152ba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297315.949890:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949896:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949904:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff982b03073600) 00010000:00010000:3.0:1789297315.949907:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297315.949910:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949916:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6a4 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949955:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b696 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d915 expref: 8 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949971:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b6ab lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d915 expref: 7 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.949985:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982b03073300) 00010000:00010000:3.0:1789297315.949988:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297315.949991:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b800, rc 0) 00000100:00100000:3.0:1789297315.950351:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:10253:x1876213933040640:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1280us (1665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297315.950361:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:1.0:1789297315.965905:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297315.966031:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933040896 00000100:00100000:3.0:1789297315.966055:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933040896 00000100:00100000:3.0:1789297315.966143:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:3.0:1789297315.966170:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:10253:x1876213933040896:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297315.966200:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297315.966228:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b6b2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d91c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.966329:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.966347:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.966362:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.968670:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.968696:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297315.968742:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.969497:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b6c7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.969521:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.969533:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b6c7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297315.969562:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789297315.970433:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970447:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970454:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970462:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152ba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297315.970467:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970476:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970492:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982b03073300) 00010000:00010000:2.0:1789297315.970495:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297315.970500:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970507:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6b9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970524:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970530:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970553:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970558:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297315.970561:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970567:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970575:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff982b03073600) 00010000:00010000:2.0:1789297315.970577:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297315.970581:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.970586:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6c0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.977615:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b6b2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d91c expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.977664:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b6c7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d91c expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297315.977676:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:2.0:1789297315.977680:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297315.977685:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257a00, rc 0) 00000100:00100000:2.0:1789297315.977828:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:10253:x1876213933040896:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 11673us (11935us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1789297315.977850:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:1.0:1789297315.996004:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297315.996165:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933041024 00000100:00100000:2.0:1789297315.996180:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933041024 00000100:00100000:2.0:1789297315.996261:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:2.0:1789297315.996274:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+9:10253:x1876213933041024:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789297315.996459:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+9:10253:x1876213933041024:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 186us (469us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297315.996468:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00010000:00010000:2.0:1789297316.349445:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789297316.477315:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789297317.357388:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297317.357434:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297317.357466:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297317.357504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933041408 00000100:00100000:0.0:1789297317.357514:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933041408 00000100:00100000:0.0:1789297317.357568:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933041280 00000100:00100000:0.0:1789297317.357570:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933041280 00000100:00100000:0.0:1789297317.357593:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:0.0:1789297317.357601:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933041408:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297317.357682:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120adf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933041408:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 81us (248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297317.357689:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:0.0:1789297317.357721:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:0.0:1789297317.357729:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:2353:x1876213933041280:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297317.357745:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933041152 00000100:00100000:1.0:1789297317.357749:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933041152 00000100:00100000:0.0:1789297317.357755:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ad180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:2353:x1876213933041280:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 28us (289us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297317.357761:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:1.0:1789297317.357775:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 284 00000100:00100000:1.0:1789297317.357784:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933041152:12345-192.168.202.43@tcp:400:kworker.0 00000100:00080000:0.0:1789297317.357786:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297317.357809:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933041152:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (433us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297317.357815:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 284 00010000:00010000:3.0:1789297317.375995:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297317.976764:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297317.977026:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933041536 00000100:00100000:3.0:1789297317.977037:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933041536 00000100:00100000:3.0:1789297317.977095:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:3.0:1789297317.977106:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:10295:x1876213933041536:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297317.977127:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297317.977149:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b6d5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d923 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977219:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977235:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977249:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977266:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977274:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977282:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977475:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977484:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977491:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977498:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152be00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297317.977503:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977511:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977525:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073000) 00010000:00010000:3.0:1789297317.977528:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297317.977533:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977539:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0b6dc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977551:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977557:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977563:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977575:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297317.977578:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977585:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977594:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff982b03073400) 00010000:00010000:3.0:1789297317.977597:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297317.977600:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977606:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0b6e3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977640:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b6d5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d923 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977650:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073000) 00010000:00010000:3.0:1789297317.977653:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297317.977656:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0b6d5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d923 expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.977665:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b600, rc 0) 00000100:00100000:3.0:1789297317.977773:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120aed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:10295:x1876213933041536:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 668us (1018us total) trans 0 rc 301/301 00000100:00100000:3.0:1789297317.977780:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:0.0:1789297317.982845:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297317.983057:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933041792 00000100:00100000:3.0:1789297317.983074:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933041792 00000100:00100000:3.0:1789297317.983147:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:3.0:1789297317.983158:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+9:10295:x1876213933041792:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:3.0:1789297317.983220:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297317.983248:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0b68f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d90e expref: 9 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.983267:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073000) 00010000:00010000:3.0:1789297317.983278:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297317.983496:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.983511:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.983522:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.983535:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.983542:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.983549:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297317.984435:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789297317.984448:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.984456:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.984469:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.984475:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152ba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297317.984479:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.984487:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.984498:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297317.984501:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297317.984506:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.984512:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0b6ea lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297317.984530:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a02ce487 reply state 00000000e877c0df transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297317.984539:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297317.984658:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120adc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+10:10295:x1876213933041792:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 1498us (1818us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789297317.984666:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00010000:00010000:3.0:1789297317.990483:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.990503:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.990525:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.990533:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297317.990538:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.990546:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.990563:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff982b03073900) 00010000:00010000:3.0:1789297317.990567:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297317.990571:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297317.990577:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f1 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297318.082422:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.082471:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933041920 00000100:00100000:3.0:1789297318.082482:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933041920 00000100:00100000:3.0:1789297318.082546:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:3.0:1789297318.082557:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:10303:x1876213933041920:12345-192.168.202.43@tcp:101:lctl.0 00010000:00010000:3.0:1789297318.082581:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297318.082605:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d92a expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.082673:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0b6ff lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.082722:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0b6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.082735:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0b6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297318.082772:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789297318.082776:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297318.082814:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0b6ff lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.082842:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b6f8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d92a expref: 11 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.082861:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0b6ff lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d92a expref: 10 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.082870:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297318.082873:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297318.082876:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e000, rc 0) 00000100:00100000:3.0:1789297318.082934:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+10:10303:x1876213933041920:12345-192.168.202.43@tcp:101:lctl.0 Request processed in 380us (523us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297318.082941:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:3.0:1789297318.139266:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.139363:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933042048 00000100:00100000:0.0:1789297318.139373:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933042048 00000100:00100000:0.0:1789297318.139432:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:0.0:1789297318.139443:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+10:10309:x1876213933042048:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297318.139463:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297318.139485:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b706 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d931 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139550:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139565:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139579:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139594:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139601:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139607:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139968:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b71b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.139978:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140004:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297318.140138:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789297318.140143:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297318.140185:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b71b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140197:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140204:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140211:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140217:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.140221:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140228:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140241:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:0.0:1789297318.140244:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297318.140248:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140254:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b70d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140280:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140285:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140291:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140297:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.140300:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140306:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140314:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff982b15d3a100) 00010000:00010000:0.0:1789297318.140317:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297318.140320:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140325:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b714 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140356:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b706 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d931 expref: 12 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140368:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b71b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d931 expref: 11 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.140385:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297318.140387:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789297318.140389:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb400, rc 0) 00000100:00100000:0.0:1789297318.140457:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+11:10309:x1876213933042048:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1016us (1202us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297318.140464:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:3.0:1789297318.143034:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.143151:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933042304 00000100:00100000:0.0:1789297318.143164:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933042304 00000100:00100000:0.0:1789297318.143234:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:0.0:1789297318.143246:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+11:10309:x1876213933042304:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297318.143271:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297318.143295:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0b722 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d938 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.143437:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.143452:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.143463:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.143478:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.143485:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.143510:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789297318.144147:0:5844:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:0.0:1789297318.144334:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144345:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144353:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144384:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144391:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144397:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144403:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.144409:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144416:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144427:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297318.144430:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297318.144440:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144446:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b729 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789297318.144461:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004727035b reply state 000000006af76dc5 transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297318.144469:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:0.0:1789297318.144498:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0b722 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144511:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.144519:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a300) 00010000:00010000:0.0:1789297318.144522:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297318.144524:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba600, rc 0) 00000100:00100000:0.0:1789297318.144601:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:10309:x1876213933042304:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1357us (1587us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1789297318.144610:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00010000:00010000:0.0:1789297318.150803:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.150822:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.150829:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.150856:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.150861:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.150868:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.150885:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b15d3a700) 00010000:00010000:0.0:1789297318.150888:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297318.150892:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.150898:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b730 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297318.152323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.153759:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933042432 00000100:00100000:0.0:1789297318.153772:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933042432 00000100:00100000:0.0:1789297318.153832:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789297318.153841:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2352:x1876213933042432:12345-192.168.202.43@tcp:8:bash.0 00010000:00080000:0.0:1789297318.153874:0:6688:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp t0 exp 0000000000000000 cur 330 last 0 00000020:00000080:0.0:1789297318.153906:0:6688:0:(genops.c:1385:class_connect()) connect: client 235dd3df-f928-4719-bb69-fc817cc2744f, cookie 0x8ad177e823a0b745 00002000:00100000:0.0:1789297318.153919:0:6688:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 235dd3df-f928-4719-bb69-fc817cc2744f/ffff982b03390000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1789297318.153943:0:6688:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:0.0:1789297318.154183:0:6688:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:0.0:1789297318.154215:0:6688:0:(import.c:65:import_set_state_nolock()) ffff982b03397800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789297318.154296:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2352:x1876213933042432:12345-192.168.202.43@tcp:8:bash.0 Request processed in 454us (1979us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297318.154320:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:3.0:1789297318.159206:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297318.159314:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933042560 00000100:00100000:2.0:1789297318.159325:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933042560 00000100:00100000:2.0:1789297318.159414:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789297318.159426:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:0:x1876213933042560:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297318.159444:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297318.159467:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d93f expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297318.159496:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297318.159516:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=330s v=(0 0) 00010000:00010000:2.0:1789297318.159521:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297318.159530:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.159553:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 7 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.159587:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257800, rc 0) 00000100:00100000:2.0:1789297318.159650:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:0:x1876213933042560:12345-192.168.202.43@tcp:101:bash.0 Request processed in 226us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297318.159657:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00080000:3.0:1789297318.159724:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297318.165457:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.165548:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933042688 00000100:00100000:0.0:1789297318.165558:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933042688 00000100:00100000:0.0:1789297318.165621:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:0.0:1789297318.165633:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:10309:x1876213933042688:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297318.165654:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297318.165677:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d946 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.165758:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.165768:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297318.165773:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297318.165778:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.165817:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.165832:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 8 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297318.165847:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876213957195776:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297318.166518:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39e1d780 going to sleep for 11 seconds 00000100:00100000:1.0:1789297318.168961:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876213957195776:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297318.169002:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297318.169040:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bba00, rc 0) 00000100:00100000:1.0:1789297318.169108:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:10309:x1876213933042688:12345-192.168.202.43@tcp:101:bash.0 Request processed in 3477us (3659us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297318.169118:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:3.0:1789297318.169221:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297318.169308:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933042816 00000100:00100000:2.0:1789297318.169316:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933042816 00010000:00010000:2.0:1789297318.169350:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 8 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297318.169380:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:2.0:1789297318.169389:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933042816:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297318.169405:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297318.169430:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 8 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.169443:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 8 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.169467:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fa5e39d1/0x8ad177e823a0b74c lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d93f expref: 8 pid: 6689 timeout: 430 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.169481:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297318.169486:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297318.169494:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.169518:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.169553:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297318.169568:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1876213957195904:192.168.202.43@tcp:105: 00000100:00100000:2.0:1789297318.169635:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b2a645cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297318.175196:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.175699:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933043072 00000100:00100000:0.0:1789297318.175770:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933043072 00000100:00100000:0.0:1789297318.175823:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:0.0:1789297318.175833:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+13:10309:x1876213933043072:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:1.0:1789297318.175900:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059ca680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1876213957195904:192.168.202.43@tcp:105: 00010000:00010000:1.0:1789297318.175931:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297318.175996:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933042816:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 6607us (6775us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297318.176005:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:0.0:1789297318.176182:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:10309:x1876213933043072:12345-192.168.202.43@tcp:35:bash.0 Request processed in 350us (996us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789297318.176190:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:1.0:1789297318.283101:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.283237:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933043328 00000100:00100000:3.0:1789297318.283249:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933043328 00000100:00100000:3.0:1789297318.283325:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789297318.283337:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:10319:x1876213933043328:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297318.283367:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297318.283390:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b75a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d94d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297318.283505:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789297318.283644:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b75a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d94d expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.283660:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297318.283663:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789297318.283668:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b75a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d94d expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.283683:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e400, rc 0) 00000100:00100000:2.0:1789297318.285912:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+15:10319:x1876213933043328:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 2566us (2808us total) trans 4294967313 rc 301/301 00000100:00100000:2.0:1789297318.285925:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:0.0:1789297318.289143:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297318.289236:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933043584 00000100:00100000:2.0:1789297318.289247:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933043584 00000100:00100000:2.0:1789297318.289305:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:2.0:1789297318.289316:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+15:10319:x1876213933043584:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789297318.289565:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+16:10319:x1876213933043584:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 250us (431us total) trans 4294967314 rc 0/0 00000100:00100000:2.0:1789297318.289572:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789297318.365987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.366128:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933043712 00000100:00100000:0.0:1789297318.366140:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933043712 00000100:00100000:0.0:1789297318.366211:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789297318.366221:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+16:10325:x1876213933043712:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297318.366246:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297318.366268:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b768 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d954 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.366341:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b76f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.366355:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b76f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.366366:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b76f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297318.366399:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:0.0:1789297318.366403:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297318.366422:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b76f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.366464:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b768 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d954 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.367057:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b76f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d954 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.367068:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297318.367072:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789297318.367075:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba200, rc 0) 00000100:00100000:0.0:1789297318.367159:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+17:10325:x1876213933043712:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 931us (1175us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297318.367168:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:1.0:1789297318.373112:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.373975:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933043968 00000100:00100000:0.0:1789297318.373989:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933043968 00000100:00100000:0.0:1789297318.374079:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:0.0:1789297318.374091:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+17:10325:x1876213933043968:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297318.374118:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297318.374143:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d95b expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.374271:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b77d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.374287:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b77d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.374299:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b77d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297318.374329:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1789297318.374677:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d95b expref: 20 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.374769:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b77d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d95b expref: 19 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.374780:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a300) 00010000:00010000:0.0:1789297318.374782:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297318.374785:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb200, rc 0) 00000100:00100000:0.0:1789297318.374869:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcdc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+19:10325:x1876213933043968:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 780us (1769us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1789297318.374878:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:2.0:1789297318.379108:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297318.379167:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297318.381971:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933044352 00000100:00100000:1.0:1789297318.381988:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933044352 00000100:00100000:1.0:1789297318.382096:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:1.0:1789297318.382108:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+19:2353:x1876213933044352:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297318.382128:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297318.382282:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b77d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d95b expref: 19 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297318.382304:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a300) 00010000:00010000:1.0:1789297318.382309:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297318.382383:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+18:2353:x1876213933044352:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 277us (3215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297318.382391:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:3.0:1789297318.383132:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933044224 00000100:00100000:3.0:1789297318.383143:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933044224 00000100:00100000:3.0:1789297318.383207:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:3.0:1789297318.383215:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:10325:x1876213933044224:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297318.383241:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297318.383261:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b78b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d962 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.383389:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b792 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.383404:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.383415:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b792 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297318.383426:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789297318.383889:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b78b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d962 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.383912:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b792 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d962 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.383922:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a300) 00010000:00010000:3.0:1789297318.383925:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789297318.383928:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e800, rc 0) 00000100:00100000:3.0:1789297318.383982:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+20:10325:x1876213933044224:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 768us (4887us total) trans 4294967316 rc 0/0 00000100:00100000:3.0:1789297318.383989:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:2.0:1789297318.388573:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.388667:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933044480 00000100:00100000:3.0:1789297318.388677:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933044480 00000100:00100000:3.0:1789297318.388966:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:3.0:1789297318.388979:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933044480:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:3.0:1789297318.389048:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.389089:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.389099:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297318.389103:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789297318.389109:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.389160:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.389176:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297318.389191:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876213957196032:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297318.389295:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b055cb180 going to sleep for 11 seconds 00000100:00100000:2.0:1789297318.391291:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876213957196032:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297318.391326:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297318.392239:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.392812:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933044608 00000100:00100000:3.0:1789297318.392824:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933044608 00002000:00100000:3.0:1789297318.392880:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff982b059c8700 x1876213933044608/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:179/0 lens 504/0 e 0 to 0 dl 1789297329 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297318.392892:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b059c8700 with x1876213933044608 ext(0->12) 00010000:00010000:3.0:1789297318.392901:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 8 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.392915:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 8 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789297318.392935:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff982b059c8700 00000100:00100000:3.0:1789297318.392974:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:3.0:1789297318.392985:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933044608:12345-192.168.202.43@tcp:4:lfs.0 00010000:00010000:0.0:1789297318.398216:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789297318.422108:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000001:00080000:1.0:1789297318.455598:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000100:00100000:3.0:1789297318.455901:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c8700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933044608:12345-192.168.202.43@tcp:4:lfs.0 Request processed in 62912us (63663us total) trans 4294967299 rc 0/0 00000100:00100000:3.0:1789297318.455915:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00002000:00100000:3.0:1789297318.455931:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff982b059c8700 x1876213933044608/t4294967299(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:179/0 lens 504/448 e 0 to 0 dl 1789297329 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297318.455942:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b059c8700 with x1876213933044608 ext(0->12) 00010000:00010000:3.0:1789297318.455953:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.455972:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789297318.455981:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff982b059c8700 00000100:00100000:2.0:1789297318.460475:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.460555:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933044736 00000100:00100000:3.0:1789297318.460566:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933044736 00010000:00010000:3.0:1789297318.460827:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297318.460908:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:3.0:1789297318.460922:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933044736:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297318.460963:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789297318.460987:0:5826:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:3.0:1789297318.460990:0:5826:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1789297318 00002000:00010000:3.0:1789297318.460992:0:5826:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1789297318 00002000:00010000:3.0:1789297318.460995:0:5826:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1789297318 00002000:00010000:3.0:1789297318.460998:0:5826:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb blocks from disk: 1 -> 11 00010000:00010000:3.0:1789297318.461005:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461030:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461059:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000104e0795/0x8ad177e823a0b753 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d946 expref: 7 pid: 6688 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461078:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789297318.461083:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789297318.461089:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461099:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461130:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297318.461203:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059ca300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933044736:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 284us (739us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297318.461212:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00010000:00010000:3.0:1789297318.461546:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461558:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461585:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461593:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461602:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461676:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297318.461682:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.461692:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.463089:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.463110:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a0dd219b/0x8ad177e823a0b7a0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297318.463291:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933044480:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 74310us (74724us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297318.463301:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:2.0:1789297318.470190:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.470395:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933044992 00000100:00100000:0.0:1789297318.470406:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933044992 00000100:00100000:0.0:1789297318.470502:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789297318.470514:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+20:10325:x1876213933044992:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:0.0:1789297318.470587:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b792 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d962 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789297318.471078:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:0.0:1789297318.471134:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:0.0:1789297318.471984:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:0.0:1789297318.472066:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.472090:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.472102:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.472141:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 24 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.472169:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 24 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297318.472183:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876213957196160:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297318.472331:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1c240 going to sleep for 11 seconds 00000100:00100000:0.0:1789297318.475528:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297318.475625:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933045120 00000100:00100000:1.0:1789297318.475634:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933045120 00010000:00010000:1.0:1789297318.475672:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 25 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297318.475833:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:3.0:1789297318.475852:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+25:2354:x1876213933045120:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297318.475870:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297318.475878:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 25 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.475892:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 25 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.475919:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a300) 00010000:00010000:3.0:1789297318.475924:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.475932:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.475940:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.475960:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297318.476021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120af800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+25:2354:x1876213933045120:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 168us (494us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297318.476030:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00010000:00010000:2.0:1789297318.477323:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b737 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d938 expref: 24 pid: 5844 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297318.477349:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ac380 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876213957196160:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297318.477375:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.477385:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.477391:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789297318.477545:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:2.0:1789297318.477938:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:2.0:1789297318.478110:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957196288:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789297318.478376:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297318.478453:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10f2ad80 going to sleep for 11 seconds 00000100:00100000:3.0:1789297318.478563:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957196288 00000100:00100000:3.0:1789297318.478571:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957196288 00000100:00100000:2.0:1789297318.479034:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297318.479045:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957196288:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789297318.479137:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957196288:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 95us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297318.479145:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297318.479350:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059cb480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957196288:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789297318.480196:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:3.0:1789297318.480277:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957196416:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789297318.480325:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297318.480351:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10f2a480 going to sleep for 11 seconds 00000100:00100000:2.0:1789297318.480435:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957196416 00000100:00100000:2.0:1789297318.480442:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957196416 00000100:00100000:2.0:1789297318.480487:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297318.480496:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957196416:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789297318.480934:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876213957196416:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 439us (607us total) trans 4294967300 rc 0/0 00000100:00100000:2.0:1789297318.480942:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297318.481064:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1500 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957196416:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:3.0:1789297318.481116:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:3.0:1789297318.481155:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.481166:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.481174:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.481180:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297318.481185:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.481193:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.481208:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a300) 00010000:00010000:3.0:1789297318.481212:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:3.0:1789297318.481216:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.481223:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0b7a7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789297318.481423:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000100:00080000:0.0:1789297318.481729:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789297318.482037:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1789297318.482050:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 330356345584ns, next at 331356343437ns, rc = 0 00000001:00080000:2.0:1789297318.482059:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1789297318.482102:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a300) 00010000:00010000:2.0:1789297318.482105:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789297318.482113:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b792 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d962 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297318.482270:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+27:10325:x1876213933044992:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 11758us (12089us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1789297318.482278:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000020:00080000:2.0:1789297318.482282:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789297318.484990:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.485079:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933045248 00000100:00100000:3.0:1789297318.485088:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933045248 00000100:00100000:3.0:1789297318.485169:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:3.0:1789297318.485179:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+27:10325:x1876213933045248:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297318.485203:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297318.485224:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b7ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d969 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.485300:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b7ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d969 expref: 28 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.485314:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b7ae lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d969 expref: 28 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.485332:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297318.485335:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789297318.485339:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f000, rc 0) 00000100:00100000:3.0:1789297318.485392:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+28:10325:x1876213933045248:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 215us (410us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297318.485400:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:0.0:1789297318.488134:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.488257:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933045504 00000100:00100000:3.0:1789297318.488268:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933045504 00000100:00100000:3.0:1789297318.488356:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:3.0:1789297318.488368:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13011c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+28:10325:x1876213933045504:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297318.488622:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13011c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+29:10325:x1876213933045504:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 255us (497us total) trans 4294967326 rc 0/0 00000100:00100000:3.0:1789297318.488642:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:0.0:1789297318.584747:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.585326:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933045760 00000100:00100000:3.0:1789297318.585339:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933045760 00000100:00100000:0.0:1789297318.585516:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:0.0:1789297318.585529:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+29:10335:x1876213933045760:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297318.585559:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297318.585581:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b7b5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d970 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297318.585692:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:0.0:1789297318.585863:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b7b5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d970 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.585878:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:0.0:1789297318.585881:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297318.585887:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b7b5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d970 expref: 31 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.585903:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba600, rc 0) 00000100:00100000:0.0:1789297318.585973:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ace00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+30:10335:x1876213933045760:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 446us (1281us total) trans 4294967327 rc 301/301 00000100:00100000:0.0:1789297318.585981:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:2.0:1789297318.591899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.591993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933045888 00000100:00100000:0.0:1789297318.592002:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933045888 00000100:00100000:0.0:1789297318.592063:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:0.0:1789297318.592073:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+30:10335:x1876213933045888:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:0.0:1789297318.592167:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592193:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592206:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592222:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592229:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592250:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592346:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592354:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592361:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789297318.592406:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592420:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592426:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592433:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592439:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.592443:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592451:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592463:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297318.592472:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297318.592478:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592485:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b7c3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592500:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592506:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592512:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592517:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbc00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.592520:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592525:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592532:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b15d3a100) 00010000:00010000:0.0:1789297318.592535:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297318.592537:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592542:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b7ca lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592557:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592569:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592575:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592580:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.592583:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592588:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.592596:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:0.0:1789297318.592599:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297318.592601:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.593441:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7d1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297318.593539:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+30:10335:x1876213933045888:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 1463us (1648us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297318.593549:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:2.0:1789297318.597809:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.597939:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933046144 00000100:00100000:3.0:1789297318.597950:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933046144 00000100:00100000:3.0:1789297318.598023:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:3.0:1789297318.598035:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+30:10335:x1876213933046144:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297318.598292:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+31:10335:x1876213933046144:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 258us (494us total) trans 4294967328 rc 0/0 00000100:00100000:3.0:1789297318.598299:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297318.637531:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.637630:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933046400 00000100:00100000:3.0:1789297318.637642:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933046400 00000100:00100000:3.0:1789297318.637751:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:3.0:1789297318.637764:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+31:10338:x1876213933046400:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297318.637791:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297318.637813:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b7d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d977 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.637893:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.637908:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.637921:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.637936:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.637958:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.637966:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638107:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638117:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638124:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297318.638133:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789297318.638253:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638261:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638268:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638274:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297318.638278:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638284:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638308:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297318.638311:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297318.638316:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638321:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b7df lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638335:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638341:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638347:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638351:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fe00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297318.638354:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638360:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638367:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b03073000) 00010000:00010000:3.0:1789297318.638369:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297318.638371:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638377:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b7e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638433:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b7d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638449:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.638458:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297318.638460:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297318.638463:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148ea00, rc 0) 00000100:00100000:3.0:1789297318.638532:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059caa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+33:10338:x1876213933046400:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 771us (1009us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1789297318.638540:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:2.0:1789297318.642590:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.642692:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933046528 00000100:00100000:0.0:1789297318.642741:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933046528 00000100:00100000:0.0:1789297318.642800:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:0.0:1789297318.642810:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+33:10338:x1876213933046528:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:0.0:1789297318.642882:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.642915:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.642928:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.642958:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.642964:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.642971:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.642977:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297318.642981:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.642989:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.643001:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:0.0:1789297318.643004:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297318.643017:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.643023:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b7fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297318.643103:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+33:10338:x1876213933046528:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 294us (523us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297318.643118:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:2.0:1789297318.646106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.646235:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933046784 00000100:00100000:3.0:1789297318.646245:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933046784 00000100:00100000:3.0:1789297318.646302:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:3.0:1789297318.646314:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+33:10338:x1876213933046784:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297318.646556:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+34:10338:x1876213933046784:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 243us (459us total) trans 4294967330 rc 0/0 00000100:00100000:3.0:1789297318.646564:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789297318.906278:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.906433:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933047040 00000100:00100000:3.0:1789297318.906444:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933047040 00000100:00100000:3.0:1789297318.906512:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:3.0:1789297318.906522:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+34:10369:x1876213933047040:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:3.0:1789297318.906547:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297318.906566:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b802 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d97e expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.907104:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.907119:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.907131:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297318.907142:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1789297318.907298:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b802 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d97e expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.907319:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d97e expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.907328:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297318.907331:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297318.907335:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fe00, rc 0) 00000100:00100000:3.0:1789297318.907397:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059ca680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+36:10369:x1876213933047040:12345-192.168.202.43@tcp:101:cat.0 Request processed in 877us (1130us total) trans 4294967331 rc 0/0 00000100:00100000:3.0:1789297318.907406:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:2.0:1789297318.912577:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.912686:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933047296 00000100:00100000:3.0:1789297318.912698:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933047296 00000100:00100000:3.0:1789297318.912798:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:3.0:1789297318.912810:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+36:10369:x1876213933047296:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:3.0:1789297318.913192:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+37:10369:x1876213933047296:12345-192.168.202.43@tcp:35:cat.0 Request processed in 384us (623us total) trans 4294967332 rc 0/0 00000100:00100000:3.0:1789297318.913209:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:2.0:1789297318.913771:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297318.920311:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933047424 00000100:00100000:1.0:1789297318.920328:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933047424 00000100:00100000:1.0:1789297318.920425:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789297318.920437:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+37:2356:x1876213933047424:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297318.920456:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297318.920483:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d97e expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297318.920511:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:1.0:1789297318.920516:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297318.920588:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3f050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+36:2356:x1876213933047424:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 153us (6819us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297318.920596:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789297318.984817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.984882:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933047680 00000100:00100000:0.0:1789297318.984893:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933047680 00000100:00100000:0.0:1789297318.984954:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:0.0:1789297318.984965:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+36:10375:x1876213933047680:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:0.0:1789297318.984992:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297318.984996:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1789297318.985038:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b76f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d954 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.985059:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297318.985064:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297318.985078:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b817 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d985 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.985381:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.985397:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.985406:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.985447:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.985464:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 36 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297318.985487:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957196544:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297318.985647:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297318.992675:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297318.992856:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933047808 00000100:00100000:3.0:1789297318.992865:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933047808 00010000:00010000:3.0:1789297318.992911:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 37 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297318.992956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:3.0:1789297318.992968:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+37:2354:x1876213933047808:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297318.992983:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297318.992991:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 37 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.993015:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 37 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.993039:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297318.993044:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.993053:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.993061:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297318.993079:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297318.993130:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+37:2354:x1876213933047808:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 165us (466us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297318.993164:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00010000:00010000:2.0:1789297318.994150:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b7ed lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d977 expref: 36 pid: 5842 timeout: 430 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297318.994192:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120af800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957196544:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297318.994214:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.994223:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.994229:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297318.994250:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:2.0:1789297318.994421:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b817 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.994438:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 36 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297318.994446:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:2.0:1789297318.994449:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297318.994451:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb000, rc 0) 00000100:00100000:2.0:1789297318.994502:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+36:10375:x1876213933047680:12345-192.168.202.43@tcp:101:dd.0 Request processed in 9539us (9693us total) trans 4294967333 rc 0/0 00000100:00100000:2.0:1789297318.994510:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:2.0:1789297318.996667:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297318.996750:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933048064 00000100:00100000:0.0:1789297318.996759:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933048064 00000100:00100000:0.0:1789297318.996803:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:0.0:1789297318.996811:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+36:10375:x1876213933048064:12345-192.168.202.43@tcp:36:dd.0 00010000:00010000:0.0:1789297318.997613:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.997632:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297318.997643:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789297318.998263:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:0.0:1789297318.998304:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000addc0fff reply state 00000000f5191c18 transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297318.998313:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789297318.998416:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+39:10375:x1876213933048064:12345-192.168.202.43@tcp:36:dd.0 Request processed in 1601us (1754us total) trans 4294967335 rc 0/0 00000100:00100000:0.0:1789297318.998424:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000020:00080000:0.0:1789297318.998429:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789297319.006968:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.007027:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.007035:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.007042:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297319.007049:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.007056:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.007074:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:2.0:1789297319.007077:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297319.007081:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.007087:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0b82c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297319.257913:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.258181:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933048192 00000100:00100000:3.0:1789297319.258191:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933048192 00000100:00100000:3.0:1789297319.258263:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:3.0:1789297319.258277:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+38:10389:x1876213933048192:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:3.0:1789297319.258300:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297319.258320:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b833 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d98c expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258381:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258394:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258405:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258419:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258426:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258432:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258509:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258536:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258543:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258577:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 39 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.258590:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 39 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297319.258618:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957196672:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297319.258947:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10f2a6c0 going to sleep for 11 seconds 00000100:00080000:0.0:1789297319.259171:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297319.261571:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.261749:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933048448 00000100:00100000:2.0:1789297319.261759:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933048448 00000100:00100000:2.0:1789297319.261819:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789297319.261829:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+40:5594:x1876213933048448:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789297319.262172:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+41:5594:x1876213933048448:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 343us (611us total) trans 4294967336 rc 0/0 00000100:00100000:2.0:1789297319.262180:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:0.0:1789297319.262404:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957196672:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297319.262443:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297319.265045:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297319.265142:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933048576 00000100:00100000:0.0:1789297319.265164:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933048576 00010000:00010000:0.0:1789297319.265203:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 41 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297319.265244:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:0.0:1789297319.265254:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+41:2354:x1876213933048576:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297319.265288:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297319.265296:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 41 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.265309:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 41 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.265332:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0b81e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d985 expref: 41 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.265348:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:0.0:1789297319.265354:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.265363:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.265371:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.265412:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297319.265473:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+40:2354:x1876213933048576:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 219us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297319.265481:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00010000:00010000:3.0:1789297319.265589:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265599:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297319.265657:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789297319.265662:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297319.265750:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265762:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265782:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265788:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265794:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265800:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297319.265804:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265811:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265821:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297319.265824:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297319.265827:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265833:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b83a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265844:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265850:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265856:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265869:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297319.265873:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265878:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265886:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b03073000) 00010000:00010000:3.0:1789297319.265888:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297319.265891:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265897:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b841 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265936:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b833 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d98c expref: 40 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265949:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d98c expref: 39 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.265956:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297319.265958:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297319.265960:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fa00, rc 0) 00000100:00100000:3.0:1789297319.265987:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+39:10389:x1876213933048192:12345-192.168.202.43@tcp:101:stat.0 Request processed in 7716us (8086us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297319.265993:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:1.0:1789297319.321659:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.321790:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933048832 00000100:00100000:3.0:1789297319.321813:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933048832 00000100:00100000:3.0:1789297319.321868:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:3.0:1789297319.321877:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+39:10395:x1876213933048832:12345-192.168.202.43@tcp:36:truncate.0 00010000:00010000:3.0:1789297319.321936:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297319.321963:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d98c expref: 39 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.321984:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297319.321989:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297319.322211:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.322222:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.322229:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297319.322265:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:3.0:1789297319.322282:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000026a3b109 reply state 00000000d8b51368 transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297319.322288:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297319.322391:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059ca300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+41:10395:x1876213933048832:12345-192.168.202.43@tcp:36:truncate.0 Request processed in 515us (741us total) trans 4294967338 rc 0/0 00000100:00100000:3.0:1789297319.322396:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00000020:00080000:3.0:1789297319.322400:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1789297319.324399:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.324414:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.324422:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.324427:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297319.324432:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.324439:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.324453:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:0.0:1789297319.324456:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297319.324460:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.324467:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b84f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.422368:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297319.427216:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.427317:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933048960 00000100:00100000:2.0:1789297319.427328:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933048960 00000100:00100000:2.0:1789297319.427391:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:2.0:1789297319.427402:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+40:10409:x1876213933048960:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:2.0:1789297319.427427:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297319.427448:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b856 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d993 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427515:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427528:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427540:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427554:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427561:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427567:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427794:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427804:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427827:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297319.427860:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:2.0:1789297319.427865:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297319.427886:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427897:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427905:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427911:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427917:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427923:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297319.427927:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427934:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427946:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297319.427949:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297319.427953:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427970:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b85d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427985:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427991:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.427997:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.428012:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297319.428016:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.428022:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.428030:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b2ac85600) 00010000:00010000:2.0:1789297319.428033:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297319.428036:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.428042:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.428071:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b856 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.428083:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 41 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.428096:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:2.0:1789297319.428099:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297319.428101:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257200, rc 0) 00000100:00100000:2.0:1789297319.428218:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+41:10409:x1876213933048960:12345-192.168.202.43@tcp:101:stat.0 Request processed in 818us (1012us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297319.428225:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:2.0:1789297319.516398:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.516485:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933049216 00000100:00100000:3.0:1789297319.516496:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933049216 00000100:00100000:3.0:1789297319.516570:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:3.0:1789297319.516607:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+41:10419:x1876213933049216:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297319.516630:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297319.516651:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b872 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d99a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297319.516790:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789297319.516913:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b872 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d99a expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.516927:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297319.516930:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789297319.516935:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b872 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d99a expref: 43 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.516951:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fa00, rc 0) 00000100:00100000:3.0:1789297319.517029:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+42:10419:x1876213933049216:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 436us (642us total) trans 4294967339 rc 301/301 00000100:00100000:3.0:1789297319.517037:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:1.0:1789297319.520450:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.520540:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933049472 00000100:00100000:2.0:1789297319.520551:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933049472 00000100:00100000:2.0:1789297319.520615:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:2.0:1789297319.520625:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+42:10419:x1876213933049472:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789297319.520897:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+43:10419:x1876213933049472:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 272us (455us total) trans 4294967340 rc 0/0 00000100:00100000:2.0:1789297319.520905:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:1.0:1789297319.580436:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.580529:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933049728 00000100:00100000:3.0:1789297319.580541:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933049728 00000100:00100000:3.0:1789297319.580618:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:3.0:1789297319.580631:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+43:10425:x1876213933049728:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789297319.580659:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297319.580680:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b880 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9a1 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.580849:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.580871:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.580880:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.580915:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.580928:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 44 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297319.580941:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957196800:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297319.581058:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b071ff9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297319.584579:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957196800:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297319.584629:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297319.585916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.586226:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933049856 00000100:00100000:3.0:1789297319.586235:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933049856 00010000:00010000:3.0:1789297319.586280:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 45 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297319.586328:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:3.0:1789297319.586338:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+45:2354:x1876213933049856:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297319.586376:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297319.586389:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 45 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.586402:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 45 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.586425:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b86b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d993 expref: 45 pid: 5843 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.586442:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297319.586447:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.586457:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.586465:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.586502:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297319.586630:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38291500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+44:2354:x1876213933049856:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 292us (720us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297319.586637:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00010000:00010000:1.0:1789297319.586859:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.586868:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297319.586890:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:1.0:1789297319.587064:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0b880 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 45 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.587096:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 44 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.587105:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:1.0:1789297319.587107:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789297319.587110:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f800, rc 0) 00000100:00100000:1.0:1789297319.587140:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38293100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+44:10425:x1876213933049728:12345-192.168.202.43@tcp:101:bash.0 Request processed in 6513us (6714us total) trans 4294967341 rc 0/0 00000100:00100000:1.0:1789297319.587148:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:0.0:1789297319.590303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.590382:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933050112 00000100:00100000:3.0:1789297319.590393:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933050112 00000100:00100000:3.0:1789297319.590457:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:3.0:1789297319.590467:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+44:10425:x1876213933050112:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:3.0:1789297319.590789:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.590824:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.590836:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297319.590894:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:3.0:1789297319.590921:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d12822e reply state 0000000020562159 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297319.590930:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297319.591028:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+47:10425:x1876213933050112:12345-192.168.202.43@tcp:36:bash.0 Request processed in 561us (733us total) trans 4294967343 rc 0/0 00000100:00100000:3.0:1789297319.591035:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00000020:00080000:3.0:1789297319.591041:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789297319.595796:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297319.596100:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933050240 00000100:00100000:0.0:1789297319.596129:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933050240 00000100:00100000:0.0:1789297319.596203:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:0.0:1789297319.596213:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+47:10425:x1876213933050240:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297319.596240:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297319.596260:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b89c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9a8 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.596342:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.596357:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 48 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.596364:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.596371:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.596390:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.596414:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 48 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.596426:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 48 pid: 7920 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297319.596438:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957196928:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297319.596531:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1cd80 going to sleep for 11 seconds 00010000:00010000:3.0:1789297319.597043:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.597053:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.597059:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.597065:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297319.597069:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.597077:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.597103:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297319.597106:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297319.597109:0:3288:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.597118:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.597125:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b895 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297319.599057:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957196928:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297319.599086:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297319.600366:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297319.600661:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933050368 00000100:00100000:0.0:1789297319.600672:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933050368 00010000:00010000:0.0:1789297319.600755:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 48 pid: 7920 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297319.600794:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:0.0:1789297319.600804:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+48:2356:x1876213933050368:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297319.600817:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297319.600825:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 48 pid: 7920 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.600838:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 48 pid: 7920 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.600860:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b887 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a1 expref: 48 pid: 7920 timeout: 431 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.600877:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:0.0:1789297319.600882:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.600892:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.600915:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.600945:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297319.600997:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+47:2356:x1876213933050368:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 194us (637us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297319.601016:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00010000:00010000:2.0:1789297319.601288:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.601296:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297319.601341:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789297319.601346:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297319.601368:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.601399:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0b89c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a8 expref: 47 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.601430:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a8 expref: 46 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.601438:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:2.0:1789297319.601441:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297319.601444:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb200, rc 0) 00000100:00100000:2.0:1789297319.601489:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38292a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+46:10425:x1876213933050240:12345-192.168.202.43@tcp:101:bash.0 Request processed in 5278us (5703us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297319.601496:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:1.0:1789297319.606233:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.606318:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933050624 00000100:00100000:2.0:1789297319.606329:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933050624 00000100:00100000:2.0:1789297319.606386:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:2.0:1789297319.606396:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13013850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+46:10425:x1876213933050624:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:2.0:1789297319.606654:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13013850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+47:10425:x1876213933050624:12345-192.168.202.43@tcp:35:bash.0 Request processed in 258us (432us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1789297319.606662:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:0.0:1789297319.683812:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.683969:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933050880 00000100:00100000:3.0:1789297319.683980:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933050880 00000100:00100000:3.0:1789297319.684053:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:3.0:1789297319.684065:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+47:10435:x1876213933050880:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297319.684090:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297319.684111:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b8aa lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9af expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297319.684217:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789297319.684344:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b8aa lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9af expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.684359:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297319.684362:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789297319.684367:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b8aa lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9af expref: 49 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.684404:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e200, rc 0) 00000100:00100000:3.0:1789297319.684614:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+48:10435:x1876213933050880:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 550us (810us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1789297319.684622:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789297319.687552:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297319.687692:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933051008 00000100:00100000:1.0:1789297319.687829:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933051008 00000100:00100000:1.0:1789297319.687941:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:1.0:1789297319.687951:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+48:10435:x1876213933051008:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:1.0:1789297319.688044:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688060:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688072:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688087:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688112:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688119:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688306:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688315:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688322:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789297319.688367:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688380:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688386:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688392:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688398:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297319.688402:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688409:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688428:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:1.0:1789297319.688431:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297319.688435:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688440:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0b8b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688453:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688459:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688464:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688469:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297319.688472:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688479:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688485:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b08585500) 00010000:00010000:1.0:1789297319.688487:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297319.688490:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688495:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b8bf lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688518:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688525:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688530:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688535:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297319.688538:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688544:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688552:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:1.0:1789297319.688554:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297319.688557:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297319.688563:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0b8c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297319.688841:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+48:10435:x1876213933051008:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 889us (1296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297319.688850:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:2.0:1789297319.691245:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.691554:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933051264 00000100:00100000:3.0:1789297319.691566:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933051264 00000100:00100000:3.0:1789297319.691631:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:3.0:1789297319.691641:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+48:10435:x1876213933051264:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297319.691932:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+49:10435:x1876213933051264:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 291us (695us total) trans 4294967346 rc 0/0 00000100:00100000:3.0:1789297319.691941:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789297319.726242:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.726389:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933051520 00000100:00100000:3.0:1789297319.726400:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933051520 00000100:00100000:3.0:1789297319.726464:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:3.0:1789297319.726475:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+49:10438:x1876213933051520:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297319.726500:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297319.726519:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b8cd lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9b6 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.726592:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.726618:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.726629:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.726659:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.726667:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.726673:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727389:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b8e2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727402:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727411:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b8e2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297319.727423:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789297319.727542:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727551:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727557:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727564:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297319.727569:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727576:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727591:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297319.727594:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297319.727932:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727941:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b8d4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727957:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727963:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727969:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727974:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148ea00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297319.727985:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.727991:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.728009:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b03073000) 00010000:00010000:2.0:1789297319.728012:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297319.728015:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.728021:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b8db lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.728071:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b8cd lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9b6 expref: 52 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.728084:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b8e2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9b6 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.728091:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:2.0:1789297319.728094:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297319.728096:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257c00, rc 0) 00000100:00100000:2.0:1789297319.729055:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+51:10438:x1876213933051520:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 2574us (2815us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1789297319.729066:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:2.0:1789297319.733091:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.733143:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297319.733409:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933051648 00000100:00100000:0.0:1789297319.733420:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933051648 00000100:00100000:0.0:1789297319.733486:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:0.0:1789297319.733496:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:10438:x1876213933051648:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:0.0:1789297319.733567:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733586:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733610:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733638:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733644:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733669:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733675:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbc00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297319.733679:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733687:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733700:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:0.0:1789297319.733744:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297319.733749:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.733765:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0b8f0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297319.733990:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:10438:x1876213933051648:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 494us (910us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297319.734007:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:3.0:1789297319.734364:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933051776 00000100:00100000:3.0:1789297319.734371:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933051776 00000100:00100000:3.0:1789297319.734422:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:3.0:1789297319.734431:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:2353:x1876213933051776:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297319.734442:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297319.734460:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0b8e2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9b6 expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.734472:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:3.0:1789297319.734476:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297319.734506:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+50:2353:x1876213933051776:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 76us (1362us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297319.734512:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789297319.737840:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.738387:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933052032 00000100:00100000:3.0:1789297319.738400:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933052032 00000100:00100000:3.0:1789297319.738460:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:3.0:1789297319.738471:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+50:10438:x1876213933052032:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789297319.739219:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:10438:x1876213933052032:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 746us (1385us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1789297319.739244:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:3.0:1789297319.871254:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957197440:0@lo:400:kworker.0 00000100:00100000:3.0:1789297319.871337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297319.871401:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297319.871407:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957197312:0@lo:400:kworker.0 00000100:00100000:3.0:1789297319.871431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297319.871462:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197312 00000100:00100000:3.0:1789297319.871469:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197312 00000100:00100000:3.0:1789297319.871521:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:3.0:1789297319.871529:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957197312:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297319.871580:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957197312:12345-0@lo:400:kworker.0 Request processed in 52us (148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297319.871587:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00080000:3.0:1789297319.871621:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297319.871654:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957197312:0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.872310:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957197184:0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.872369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297319.872399:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957197696:0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.872422:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297319.872450:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789297319.872456:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957197056:0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.872480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297319.872499:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957197568:0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.872518:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297319.872545:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197440 00000100:00100000:1.0:1789297319.872550:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197440 00000100:00100000:1.0:1789297319.872581:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197696 00000100:00100000:1.0:1789297319.872584:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197696 00000100:00100000:1.0:1789297319.872622:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789297319.872629:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957197440:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.872671:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957197440:12345-0@lo:400:kworker.0 Request processed in 43us (1334us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297319.872678:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789297319.872692:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789297319.872698:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957197696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297319.873036:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197056 00000100:00100000:3.0:1789297319.873041:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197056 00000100:00100000:3.0:1789297319.873072:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:3.0:1789297319.873079:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957197056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297319.873119:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12156450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957197056:12345-0@lo:400:kworker.0 Request processed in 41us (638us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297319.873126:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1789297319.873266:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277de300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957197696:12345-0@lo:400:kworker.0 Request processed in 568us (842us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297319.873273:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1789297319.873293:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197184 00000100:00100000:1.0:1789297319.873296:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197184 00000100:00100000:1.0:1789297319.873315:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197568 00000100:00100000:1.0:1789297319.873318:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197568 00000100:00100000:1.0:1789297319.873332:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789297319.873337:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957197184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.873374:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957197184:12345-0@lo:400:kworker.0 Request processed in 37us (1006us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297319.873380:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1789297319.873391:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1789297319.873396:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957197568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297319.873418:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3303:x1876213957197568:12345-0@lo:400:kworker.0 Request processed in 23us (900us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297319.873423:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:1.0:1789297319.873463:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789297319.873468:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297319.873504:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957197440:0@lo:400:kworker.0 00000100:00100000:2.0:1789297319.874063:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957197056:0@lo:400:kworker.0 00000100:00100000:2.0:1789297319.874077:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3303:1876213957197568:0@lo:400:kworker.0 00000100:00100000:2.0:1789297319.874088:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957197184:0@lo:400:kworker.0 00000100:00100000:2.0:1789297319.874096:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957197696:0@lo:400:kworker.0 00000001:00080000:3.0:1789297319.928925:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967335 is committed 00000001:00080000:3.0:1789297319.929063:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967341 is committed 00000001:00080000:3.0:1789297319.929450:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967347 is committed 00000001:00080000:3.0:1789297319.929565:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967348 is committed 00000004:00080000:3.0:1789297319.929604:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:3.0:1789297319.929633:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b05bee540 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:3.0:1789297319.929639:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b11e02500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b05bee000 00000020:00080000:3.0:1789297319.929658:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b11e02400 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982b120aac00 00000020:00080000:2.0:1789297319.929974:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000020:00080000:2.0:1789297319.930135:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:1.0:1789297319.930482:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789297319.930503:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957197824:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1789297319.930586:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297319.930979:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197824 00000100:00100000:3.0:1789297319.930987:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197824 00000100:00100000:3.0:1789297319.931091:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1789297319.931104:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957197824:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789297319.931134:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:3.0:1789297319.931257:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6aa682a6, atime: 0x6aa682a6, ctime: 0x6aa682a6, blocks: 0xb 00010000:00010000:3.0:1789297319.931266:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.931284:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=331s v=(0 0) 00010000:00010000:3.0:1789297319.931289:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297319.931296:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.931315:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.931326:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.931335:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297319.931353:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789297319.932137:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277df480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3305:x1876213957197824:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1034us (1548us total) trans 4294967301 rc 0/0 00000004:00080000:2.0:1789297319.932297:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b40953b80/2, rc 0, transno 4294967301 00000100:00100000:2.0:1789297319.932304:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40953b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957197824:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1789297319.932346:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:0.0:1789297319.932410:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297319.932418:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.932428:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fe00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297319.932433:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.932455:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.932479:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.932486:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b45cfd78/0x8ad177e823a0b8f7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.932509:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297319.932511:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297319.932513:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297319.938261:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.938337:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933052288 00000100:00100000:2.0:1789297319.938347:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933052288 00000100:00100000:2.0:1789297319.938405:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:2.0:1789297319.938415:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+11:10456:x1876213933052288:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:2.0:1789297319.938442:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297319.938461:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0b8fe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9bd expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.938556:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b905 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.938569:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.938580:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b905 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297319.938621:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789297319.938890:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0b8fe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9bd expref: 14 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.938907:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b905 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9bd expref: 13 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.938915:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:2.0:1789297319.938918:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789297319.938921:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256400, rc 0) 00000100:00100000:2.0:1789297319.938974:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+13:10456:x1876213933052288:12345-192.168.202.43@tcp:101:cat.0 Request processed in 560us (722us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1789297319.938981:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:0.0:1789297319.970177:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.970311:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933052416 00000100:00100000:2.0:1789297319.970321:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933052416 00000100:00100000:2.0:1789297319.970405:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789297319.970413:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:10457:x1876213933052416:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297319.970437:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297319.970455:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0b913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9c4 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.970517:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b91a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.970529:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.970554:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297319.970584:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789297319.970587:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297319.970601:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b91a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.970627:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0b913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9c4 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.970646:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b91a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9c4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.970654:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297319.970657:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297319.970661:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256800, rc 0) 00000100:00100000:2.0:1789297319.970833:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40953100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+14:10457:x1876213933052416:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 418us (677us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297319.970840:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:0.0:1789297319.982266:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297319.982419:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933052800 00000100:00100000:3.0:1789297319.982429:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933052800 00000100:00100000:3.0:1789297319.982487:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:3.0:1789297319.982495:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+14:10457:x1876213933052800:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789297319.983274:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+15:10457:x1876213933052800:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 774us (1016us total) trans 4294967350 rc 0/0 00000100:00100000:0.0:1789297319.983284:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:1.0:1789297319.985554:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297319.985661:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933052928 00000100:00100000:0.0:1789297319.985672:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933052928 00000100:00100000:0.0:1789297319.985848:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:0.0:1789297319.985859:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+15:10457:x1876213933052928:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:0.0:1789297319.985875:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789297319.985898:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0b8a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9a8 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.985931:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0b905 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9bd expref: 14 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.985939:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b7ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d969 expref: 13 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297319.985947:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073600) 00010000:00010000:0.0:1789297319.985958:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297319.986016:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dc000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+12:10457:x1876213933052928:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 160us (471us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297319.986021:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:1.0:1789297319.988041:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297319.988123:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933053056 00000100:00100000:2.0:1789297319.988133:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933053056 00000100:00100000:2.0:1789297319.988193:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:2.0:1789297319.988203:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+12:10457:x1876213933053056:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:2.0:1789297319.988330:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.988347:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297319.988364:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789297319.989173:0:7920:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789297319.989350:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1789297319.989418:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1789297319.989641:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+12:10457:x1876213933053056:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 1436us (1603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297319.989651:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:3.0:1789297320.017153:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297320.017406:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933053184 00000100:00100000:2.0:1789297320.017417:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933053184 00000100:00100000:3.0:1789297320.017572:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:3.0:1789297320.017583:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+12:10459:x1876213933053184:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297320.017617:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297320.017642:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9cb expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.017723:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.017737:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.017748:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.017763:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.017769:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.017791:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018055:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018332:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018344:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297320.018385:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1789297320.018389:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297320.018408:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018420:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018428:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018435:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018442:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018448:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297320.018452:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018460:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018481:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297320.018486:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297320.018491:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018497:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b92f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018509:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018515:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018521:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018526:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fe00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297320.018529:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018535:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018542:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b03073800) 00010000:00010000:3.0:1789297320.018544:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297320.018547:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018552:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018598:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.018613:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.021314:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:3.0:1789297320.021320:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297320.021326:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e200, rc 0) 00000100:00100000:3.0:1789297320.021429:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+13:10459:x1876213933053184:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 3842us (4281us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297320.021438:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789297320.382127:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297320.382151:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957197952:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297320.382241:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297320.382378:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957197952 00000100:00100000:0.0:1789297320.382386:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957197952 00000100:00100000:0.0:1789297320.382447:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1789297320.382457:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957197952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297320.382495:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297320.382553:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957197952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 97us (312us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297320.382560:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1789297320.385406:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40952d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957197952:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789297320.447443:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789297320.573209:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789297320.573231:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789297320.573305:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789297320.573313:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789297320.573482:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957198080:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789297320.573603:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297320.579798:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0a80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957198080:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789297320.586810:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297320.586943:0:5854:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933053312 00000100:00100000:0.0:1789297320.586955:0:5854:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933053312 00000100:00100000:0.0:1789297320.587023:0:5854:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:0.0:1789297320.587035:0:5854:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933053312:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789297320.587128:0:5854:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0001:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933053312:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 Request processed in 94us (330us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297320.587150:0:5854:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:3.0:1789297320.592046:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297320.592264:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933053440 00000100:00100000:1.0:1789297320.592275:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933053440 00000100:00100000:1.0:1789297320.592491:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:1.0:1789297320.592505:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933053440:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789297320.592545:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789297320.594181:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933053440:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 1669us (2136us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297320.594209:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:1.0:1789297320.599232:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297320.610006:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933053568 00000100:00100000:2.0:1789297320.610023:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933053568 00000100:00100000:2.0:1789297320.610094:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:2.0:1789297320.610105:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933053568:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1789297320.610177:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610194:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610205:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610244:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610253:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610268:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610296:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610304:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610310:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297320.610345:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1789297320.610350:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297320.610362:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610374:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610380:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610386:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610392:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297320.610396:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610403:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610433:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:2.0:1789297320.610435:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297320.610441:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610446:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0b944 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610457:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610463:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610469:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610473:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297320.610476:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610481:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610487:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff982b2ac85e00) 00010000:00010000:2.0:1789297320.610489:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297320.610491:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610496:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0b94b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610519:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610525:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610530:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610535:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297320.610538:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610543:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610549:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:2.0:1789297320.610551:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297320.610554:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.610559:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297320.610642:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277de680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933053568:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 539us (11429us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297320.610649:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:0.0:1789297320.625593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297320.632041:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933053824 00000100:00100000:1.0:1789297320.632062:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933053824 00000100:00100000:1.0:1789297320.632240:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:1.0:1789297320.632252:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933053824:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297320.632277:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297320.632299:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b959 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9d2 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632425:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632440:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632452:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297320.632464:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:1.0:1789297320.632559:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632566:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632573:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632578:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297320.632590:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632599:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632611:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:1.0:1789297320.632614:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789297320.632619:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632624:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3c00/0x8ad177e823a0b960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632666:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b959 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9d2 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632677:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:1.0:1789297320.632679:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789297320.632683:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0b959 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9d2 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297320.632691:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3a00, rc 0) 00000100:00100000:1.0:1789297320.632799:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:10470:x1876213933053824:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 549us (7215us total) trans 4294967351 rc 301/301 00000100:00100000:1.0:1789297320.632806:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:3.0:1789297320.641124:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297320.642357:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933053952 00000100:00100000:0.0:1789297320.642371:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933053952 00000100:00100000:0.0:1789297320.643003:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:0.0:1789297320.643018:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:10470:x1876213933053952:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789297320.643059:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789297320.643376:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:10470:x1876213933053952:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 362us (2262us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297320.643385:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:0.0:1789297320.657438:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.657616:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933054208 00000100:00100000:3.0:1789297320.657628:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933054208 00000100:00100000:3.0:1789297320.657690:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:3.0:1789297320.657700:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:10470:x1876213933054208:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297320.657766:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297320.657769:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1789297320.657796:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0b91a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9c4 expref: 14 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.657815:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297320.657819:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297320.657832:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b96e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9d9 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1789297320.659109:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:3.0:1789297320.659370:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b975 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.659386:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.659398:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b975 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.660559:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0b96e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9d9 expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.660580:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b975 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9d9 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.660778:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073b00) 00010000:00010000:3.0:1789297320.660781:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297320.660789:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fe00, rc 0) 00000100:00100000:3.0:1789297320.660857:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40953800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+15:10470:x1876213933054208:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 3157us (3428us total) trans 4294967352 rc 0/0 00000100:00100000:3.0:1789297320.663501:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:1.0:1789297320.671113:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.671677:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933054464 00000100:00100000:3.0:1789297320.671687:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933054464 00000100:00100000:3.0:1789297320.671778:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:3.0:1789297320.671790:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+15:10470:x1876213933054464:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789297320.672083:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297320.672115:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b975 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9d9 expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.672135:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073b00) 00010000:00010000:3.0:1789297320.672150:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297320.672186:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.672199:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.672209:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.672270:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.672278:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.672285:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673032:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673043:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673050:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673055:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297320.673060:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673067:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673076:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297320.673079:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297320.673083:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673088:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b983 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673098:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673104:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673109:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673123:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148ea00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297320.673126:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673132:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673140:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xe0a60391 (ffff982b03073200) 00010000:00010000:3.0:1789297320.673143:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297320.673146:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.673151:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b98a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xe0a60391 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297320.673321:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:10470:x1876213933054464:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 1530us (2214us total) trans 0 rc -2/-2 00000100:00100000:3.0:1789297320.673329:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:1.0:1789297320.676654:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.677672:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933054592 00000100:00100000:3.0:1789297320.677684:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933054592 00000100:00100000:3.0:1789297320.677951:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:3.0:1789297320.678028:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:10470:x1876213933054592:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297320.678051:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297320.678078:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b991 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9e0 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.678116:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.678147:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.678493:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.679482:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b991 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.679510:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.679520:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297320.679522:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1789297320.679525:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f800, rc 0) 00000100:00100000:3.0:1789297320.679698:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+15:10470:x1876213933054592:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1673us (3054us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297320.679730:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:1.0:1789297320.695340:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297320.695416:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933054848 00000100:00100000:2.0:1789297320.695426:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933054848 00000100:00100000:2.0:1789297320.695483:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:2.0:1789297320.695505:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+15:10470:x1876213933054848:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789297320.695588:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.695612:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297320.695625:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789297320.696154:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:2.0:1789297320.696166:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 332570461571ns, next at 333570458694ns, rc = 0 00000004:00010000:2.0:1789297320.696258:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008ada9d0a reply state 00000000c5fbb953 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297320.696269:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1789297320.696364:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277df100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+17:10470:x1876213933054848:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 859us (1033us total) trans 4294967353 rc 0/0 00000100:00100000:2.0:1789297320.696371:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00010000:00010000:3.0:1789297320.701501:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.701520:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.701528:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.701535:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297320.701541:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.701563:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.701581:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297320.701596:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789297320.701601:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.701607:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0b99f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297320.706558:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.712133:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933054976 00000100:00100000:3.0:1789297320.712151:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933054976 00000100:00100000:3.0:1789297320.712331:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:3.0:1789297320.712342:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+16:10470:x1876213933054976:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297320.712367:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297320.712388:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9e7 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.712450:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.712464:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.712483:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297320.712486:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789297320.712489:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e400, rc 0) 00000100:00100000:3.0:1789297320.712556:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+17:10470:x1876213933054976:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 216us (6009us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297320.712562:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:2.0:1789297320.718084:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297320.718127:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933055104 00000100:00100000:2.0:1789297320.718137:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933055104 00000100:00100000:2.0:1789297320.718175:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:2.0:1789297320.718183:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1876213933055104:12345-192.168.202.43@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1789297320.718214:0:11700:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp t0 exp 0000000000000000 cur 332 last 0 00000020:00000080:2.0:1789297320.718246:0:11700:0:(genops.c:1385:class_connect()) connect: client 235dd3df-f928-4719-bb69-fc817cc2744f, cookie 0x8ad177e823a0b9ad 00002000:00100000:2.0:1789297320.718259:0:11700:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 235dd3df-f928-4719-bb69-fc817cc2744f/ffff982b39c17800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789297320.718270:0:11700:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789297320.718534:0:11700:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789297320.718571:0:11700:0:(import.c:65:import_set_state_nolock()) ffff982b39c10000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297320.718656:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2352:x1876213933055104:12345-192.168.202.43@tcp:8:lhsmtool_posix.0 Request processed in 472us (582us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297320.718664:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:1.0:1789297320.728967:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.729737:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933055232 00000100:00100000:3.0:1789297320.729748:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933055232 00000100:00100000:3.0:1789297320.729816:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:3.0:1789297320.729827:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:0:x1876213933055232:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1789297320.732826:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297320.779092:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:0:x1876213933055232:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 49257us (50123us total) trans 4294967301 rc 0/0 00000100:00100000:0.0:1789297320.779107:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000001:00100000:0.0:1789297320.779143:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000001:00080000:0.0:1789297320.779159:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:3.0:1789297320.785268:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297320.794770:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933055488 00000100:00100000:1.0:1789297320.794786:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933055488 00000100:00100000:1.0:1789297320.794848:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:1.0:1789297320.794858:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+17:10470:x1876213933055488:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789297320.795113:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:10470:x1876213933055488:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 255us (9855us total) trans 4294967354 rc 0/0 00000100:00100000:1.0:1789297320.795122:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:1.0:1789297320.797329:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297320.797370:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933055744 00000100:00100000:1.0:1789297320.797380:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933055744 00000100:00100000:1.0:1789297320.797432:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:1.0:1789297320.797441:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:10470:x1876213933055744:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789297320.797536:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277ded80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:10470:x1876213933055744:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 96us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297320.797543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:1.0:1789297320.800480:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.800602:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933055872 00000100:00100000:3.0:1789297320.800614:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933055872 00000100:00100000:3.0:1789297320.800667:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:3.0:1789297320.800678:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+18:10470:x1876213933055872:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297320.800731:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297320.800753:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b9b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9ee expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.800823:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b9bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.800839:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.800851:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297320.800890:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297320.800908:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b9bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.800951:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0b9b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9ee expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.800969:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b9bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9ee expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.800978:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297320.800981:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1789297320.800984:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f000, rc 0) 00000100:00100000:3.0:1789297320.801054:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277ddf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+19:10470:x1876213933055872:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 378us (584us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297320.801062:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:1.0:1789297320.806180:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.806261:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933056000 00000100:00100000:3.0:1789297320.806272:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933056000 00000100:00100000:3.0:1789297320.806329:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:3.0:1789297320.806340:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933056000:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297320.806360:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297320.806383:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9f5 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789297320.806410:0:11700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa682a8, blocks: 0x1 00010000:00010000:3.0:1789297320.806430:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=332s v=(0 0) 00010000:00010000:3.0:1789297320.806434:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297320.806444:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 6 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.806483:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 6 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.806497:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fe00, rc 0) 00000100:00100000:3.0:1789297320.806552:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933056000:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 213us (384us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297320.806558:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:3.0:1789297320.810513:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297320.810628:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933056256 00000100:00100000:1.0:1789297320.810641:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933056256 00000100:00100000:1.0:1789297320.811126:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:1.0:1789297320.811140:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+19:10470:x1876213933056256:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789297320.811246:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+19:10470:x1876213933056256:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 110us (744us total) trans 0 rc 0/0 00000040:00080000:2.0:1789297320.814968:0:12013:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297320.814978:0:12013:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297320.821453:0:12013:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1789297320.821467:0:12013:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789297320.823316:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:0.0:1789297320.825931:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.830399:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933056384 00000100:00100000:3.0:1789297320.830415:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933056384 00000100:00100000:0.0:1789297320.830564:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789297320.830575:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:10470:x1876213933056384:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297320.830603:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297320.830625:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57d9fc expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297320.830673:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 7 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297320.830682:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297320.830687:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297320.830693:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297320.830766:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 7 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297320.830782:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 7 pid: 11700 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297320.830797:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40950700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957198208:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297320.831029:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063970c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297320.834336:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.835110:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40950700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957198208:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297320.835144:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.835173:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb200, rc 0) 00000100:00100000:3.0:1789297320.835238:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:10470:x1876213933056384:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 4664us (9316us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297320.835247:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:2.0:1789297320.836667:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933056512 00000100:00100000:2.0:1789297320.836679:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933056512 00010000:00010000:3.0:1789297320.842979:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 7 pid: 11700 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297320.843038:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:3.0:1789297320.843051:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933056512:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297320.843080:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297320.843107:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 7 pid: 11700 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.843122:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 7 pid: 11700 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.843145:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b45cfd78/0x8ad177e823a0b9c2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9f5 expref: 7 pid: 11700 timeout: 432 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.843162:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297320.843167:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297320.843175:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.843186:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297320.843226:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 6 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297320.843242:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1876213957198336:192.168.202.43@tcp:105: 00000100:00100000:3.0:1789297320.843331:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7f00 going to sleep for 11 seconds 00000100:00100000:0.0:1789297320.859009:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297320.859102:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933056640 00000100:00100000:2.0:1789297320.859114:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933056640 00002000:00100000:2.0:1789297320.859188:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff982b40952300 x1876213933056640/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:181/0 lens 504/0 e 0 to 0 dl 1789297331 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789297320.859201:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b40952300 with x1876213933056640 ext(0->8) 00002000:00010000:2.0:1789297320.859207:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b40952300 00000100:00100000:2.0:1789297320.859247:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:2.0:1789297320.859259:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933056640:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:2.0:1789297320.860177:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40952300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:2353:x1876213933056640:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 918us (1183us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789297320.860186:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00002000:00100000:2.0:1789297320.860194:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff982b40952300 x1876213933056640/t4294967302(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:181/0 lens 504/448 e 0 to 0 dl 1789297331 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789297320.860203:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b40952300 with x1876213933056640 ext(0->8) 00002000:00010000:2.0:1789297320.860207:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b40952300 00000100:00100000:3.0:1789297320.862748:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1c00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5827:1876213957198336:192.168.202.43@tcp:105: 00010000:00010000:3.0:1789297320.862775:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297320.862834:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3fc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933056512:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 19785us (28508us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297320.862844:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789297320.869295:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.869561:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933056768 00000100:00100000:3.0:1789297320.869575:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933056768 00000100:00100000:3.0:1789297320.869643:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:3.0:1789297320.869654:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+19:10470:x1876213933056768:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000100:00100000:1.0:1789297320.905570:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b277dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957198464:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297320.905673:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297320.907670:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957198464 00000100:00100000:0.0:1789297320.907695:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957198464 00000100:00100000:0.0:1789297320.907785:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789297320.907795:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957198464:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297320.907835:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297320.907922:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957198464:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297320.907930:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1789297320.908159:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b277dce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957198464:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789297320.908298:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:2.0:1789297320.965765:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000004:00080000:2.0:1789297320.965787:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00000020:00080000:2.0:1789297320.965812:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000100:00100000:2.0:1789297320.965942:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933056768:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 96283us (96652us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297320.965953:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00000020:00080000:2.0:1789297320.966010:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1789297320.966021:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:0.0:1789297320.966357:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789297320.966373:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957198592:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789297320.966424:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297320.967067:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957198592 00000100:00100000:2.0:1789297320.967076:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957198592 00000100:00100000:2.0:1789297320.967127:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1789297320.967137:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957198592:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789297320.967300:0:11700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789297320.967304:0:11700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789297321 00002000:00010000:2.0:1789297320.967307:0:11700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789297320.967309:0:11700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789297320 -> 1789297321 00002000:00010000:2.0:1789297320.967311:0:11700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789297320.967353:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957198592:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (929us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789297320.967360:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1789297320.968103:0:3302:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b40953480/2, rc 0, transno 4294967303 00000100:00100000:0.0:1789297320.968111:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40953480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957198592:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789297320.973294:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297320.973513:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933056896 00000100:00100000:3.0:1789297320.973526:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933056896 00000100:00100000:3.0:1789297320.973605:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:3.0:1789297320.973616:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933056896:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1789297321.041346:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1789297321.041363:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1789297321.041757:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933056896:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 68136us (68465us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297321.041769:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:1.0:1789297321.049693:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297321.049976:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933057152 00000100:00100000:3.0:1789297321.049995:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933057152 00000100:00100000:3.0:1789297321.050070:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:3.0:1789297321.050088:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933057152:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789297321.050145:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297321.050283:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0b9bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9ee expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.050303:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297321.050309:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297321.050339:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.050370:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.050381:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297321.051376:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ffb25047 reply state 00000000d712f774 transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297321.051391:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297321.051510:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:10470:x1876213933057152:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 1429us (1824us total) trans 4294967355 rc 0/0 00000100:00100000:3.0:1789297321.051518:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00080000:1.0:1789297321.052832:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297321.059848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297321.059881:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933057280 00000100:00100000:2.0:1789297321.059892:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933057280 00000100:00100000:2.0:1789297321.059951:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:2.0:1789297321.060360:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933057280:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789297321.060633:0:11700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789297321.060637:0:11700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789297321 -> 1789297319 00002000:00010000:2.0:1789297321.060650:0:11700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1789297318 00002000:00010000:2.0:1789297321.060653:0:11700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789297321 -> 1789297319 00002000:00010000:2.0:1789297321.060655:0:11700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789297321.060832:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933057280:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 476us (996us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789297321.060841:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00010000:00010000:3.0:1789297321.061106:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.061116:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.061125:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.061132:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fe00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297321.061136:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.061144:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.061160:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297321.061170:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297321.061176:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.061182:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9d0 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297321.068821:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297321.069068:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933057536 00000100:00100000:1.0:1789297321.069079:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933057536 00000100:00100000:1.0:1789297321.069135:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:1.0:1789297321.069147:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+13:10470:x1876213933057536:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1789297321.069227:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.069247:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.069257:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.069316:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.069331:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 13 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297321.069347:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957198720:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297321.069437:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0540 going to sleep for 11 seconds 00000100:00100000:2.0:1789297321.086471:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259ca80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957198720:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297321.086509:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297321.087910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297321.088040:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933057664 00000100:00100000:3.0:1789297321.088050:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933057664 00010000:00010000:3.0:1789297321.088097:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297321.088132:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:3.0:1789297321.088143:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:2353:x1876213933057664:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297321.088157:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297321.088164:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088176:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088197:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e0 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088212:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297321.088217:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088226:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088246:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088268:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297321.088318:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+13:2353:x1876213933057664:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 178us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297321.088325:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00010000:00010000:3.0:1789297321.088348:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088355:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088382:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088388:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088395:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088401:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297321.088405:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088413:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088421:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297321.088430:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789297321.088434:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.088440:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9d7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297321.088480:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+12:10470:x1876213933057536:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 19335us (19668us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789297321.088488:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:3.0:1789297321.091414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297321.091479:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933057792 00000100:00100000:0.0:1789297321.091490:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933057792 00000100:00100000:0.0:1789297321.091547:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:0.0:1789297321.091557:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933057792:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789297321.091614:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.091634:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.091642:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297321.091647:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789297321.091652:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.091689:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.091839:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 7 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297321.091855:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957198848:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297321.092495:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10f2a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297321.096680:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297321.096843:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40950000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957198848:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297321.096870:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297321.097374:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933057920 00000100:00100000:1.0:1789297321.097400:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933057920 00010000:00010000:1.0:1789297321.097444:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 8 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297321.097495:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:1.0:1789297321.097505:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933057920:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297321.097522:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297321.097546:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 8 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.097560:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 8 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.097599:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000007eb7572/0x8ad177e823a0b9c9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9fc expref: 8 pid: 6689 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.097618:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297321.097622:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297321.097628:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.097638:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.097671:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297321.097926:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933057920:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 421us (1255us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297321.097944:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00010000:00010000:2.0:1789297321.098793:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098808:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098840:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098849:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098856:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098877:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bae00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297321.098881:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098890:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098904:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297321.098911:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000dfa0fe9/0x8ad177e823a0b9de lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297321.099008:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933057792:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 7450us (7601us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297321.099018:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:2.0:1789297321.102658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297321.102802:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933058176 00000100:00100000:3.0:1789297321.102814:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933058176 00000100:00100000:3.0:1789297321.102876:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:3.0:1789297321.102886:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+12:10470:x1876213933058176:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789297321.102973:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.103000:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.103014:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.103439:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.103453:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.103462:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.103512:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 13 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.103529:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 13 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297321.103544:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957198976:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297321.103743:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b053046c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297321.106532:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957198976:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297321.106570:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297321.107659:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297321.107746:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933058304 00000100:00100000:1.0:1789297321.107754:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933058304 00010000:00010000:1.0:1789297321.107787:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297321.107819:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:1.0:1789297321.107827:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:2354:x1876213933058304:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297321.107841:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297321.107847:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.107861:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.107882:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0b9a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9e7 expref: 14 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.107899:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:1.0:1789297321.107903:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.107913:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.107920:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.107965:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297321.108022:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+13:2354:x1876213933058304:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 195us (369us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297321.108029:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00010000:00010000:3.0:1789297321.108429:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.108438:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297321.108630:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:3.0:1789297321.108797:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:3.0:1789297321.108841:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:3.0:1789297321.108914:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1876213957199104:0@lo:1000:mdt00_003.0 00000100:00100000:3.0:1789297321.109310:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297321.109345:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec000 going to sleep for 11 seconds 00000100:00100000:0.0:1789297321.109746:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957199104 00000100:00100000:0.0:1789297321.109754:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957199104 00000100:00100000:0.0:1789297321.109808:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789297321.109816:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7920:x1876213957199104:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789297321.109914:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38291500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7920:x1876213957199104:12345-0@lo:1000:mdt00_003.0 Request processed in 99us (604us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297321.109921:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789297321.109970:0:7920:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:0.0:1789297321.109976:0:7920:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b40953480, transno 4294967303 00000100:00100000:0.0:1789297321.109997:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1876213957199104:0@lo:1000:mdt00_003.0 00000001:00080000:0.0:1789297321.110450:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:0.0:1789297321.110527:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40950000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1876213957199232:0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789297321.110563:0:7920:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297321.110584:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b08e68600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297321.110807:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957199232 00000100:00100000:0.0:1789297321.110812:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957199232 00000100:00100000:0.0:1789297321.110834:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789297321.110841:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:7920:x1876213957199232:12345-0@lo:1000:mdt00_003.0 00000100:00100000:0.0:1789297321.111009:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:7920:x1876213957199232:12345-0@lo:1000:mdt00_003.0 Request processed in 168us (446us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1789297321.111017:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789297321.111050:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40950000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:7920:1876213957199232:0@lo:1000:mdt00_003.0 00010000:00010000:0.0:1789297321.111079:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111089:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111097:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111103:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297321.111107:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111115:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111129:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b03073a00) 00010000:00010000:0.0:1789297321.111132:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297321.111143:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111148:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0b9ec lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111188:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111194:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111199:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111204:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297321.111207:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111213:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111220:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:0.0:1789297321.111223:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297321.111225:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111231:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0b921 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111249:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111264:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111277:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111300:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.111313:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 16 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297321.111324:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40953480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957199360:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297321.111382:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39cf8300 going to sleep for 11 seconds 00000100:00080000:1.0:1789297321.112071:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297321.115150:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40953480 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957199360:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297321.115180:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297321.116669:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297321.116874:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933058432 00000100:00100000:3.0:1789297321.116884:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933058432 00010000:00010000:3.0:1789297321.116931:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 17 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297321.116979:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789297321.116999:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+17:2354:x1876213933058432:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297321.117029:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297321.117037:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 17 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.117050:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 17 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.117074:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0b93d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d9cb expref: 17 pid: 5844 timeout: 432 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.117092:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:3.0:1789297321.117097:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.117107:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.117115:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.117147:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297321.117202:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40953480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+16:2354:x1876213933058432:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 213us (542us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297321.117209:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00010000:00010000:0.0:1789297321.117346:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117355:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117368:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117375:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117393:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117399:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297321.117403:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117411:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117420:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:0.0:1789297321.117422:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297321.117426:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117433:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0b9f3 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117445:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117451:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117457:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117462:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fe00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297321.117464:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117480:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117489:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:0.0:1789297321.117491:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789297321.117494:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297321.117500:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0b9e5 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297321.117745:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+15:10470:x1876213933058176:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 14860us (15096us total) trans 4294967360 rc 0/0 00000100:00100000:0.0:1789297321.117755:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 83 00000020:00080000:0.0:1789297321.117759:0:7920:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789297321.118879:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789297321.118888:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789297321.118919:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:3.0:1789297321.118925:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789297321.121254:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297321.121357:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933058688 00000100:00100000:1.0:1789297321.121368:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933058688 00000100:00100000:1.0:1789297321.121428:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:1.0:1789297321.121438:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+15:10470:x1876213933058688:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789297321.122144:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789297321.122247:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:1.0:1789297321.122291:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.122307:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.122319:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.122327:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.122334:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.122342:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297321.122364:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789297321.122456:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+17:10470:x1876213933058688:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 1018us (1211us total) trans 4294967362 rc 0/0 00000100:00100000:1.0:1789297321.122464:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000020:00080000:1.0:1789297321.122469:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789297321.122558:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297321.122565:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.122572:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297321.122576:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.122584:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.122599:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff982b08585200) 00010000:00010000:3.0:1789297321.122602:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789297321.122606:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.122613:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0b9fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297321.122628:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297321.122630:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297321.122631:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297321.468885:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297322.482126:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297322.482184:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297322.482334:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933058944 00000100:00100000:3.0:1789297322.482346:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933058944 00000100:00100000:3.0:1789297322.482426:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:3.0:1789297322.482440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+17:2354:x1876213933058944:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297322.482540:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+17:2354:x1876213933058944:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 104us (426us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297322.482549:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:0.0:1789297322.485176:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933059200 00000100:00100000:0.0:1789297322.485192:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933059200 00000100:00100000:1.0:1789297322.485418:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:1.0:1789297322.485430:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933059200:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297322.486122:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933059200:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 692us (3934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297322.486132:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00080000:0.0:1789297322.487239:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789297322.489620:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297322.490236:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933058816 00000100:00100000:0.0:1789297322.490247:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933058816 00000100:00100000:0.0:1789297322.490315:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 286 00000100:00100000:0.0:1789297322.490327:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933058816:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297322.491113:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2353:x1876213933058816:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 784us (1497us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297322.491124:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 286 00000100:00100000:2.0:1789297322.491217:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297322.491367:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297322.491434:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933059072 00000100:00100000:3.0:1789297322.491449:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933059072 00000100:00100000:3.0:1789297322.491510:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:3.0:1789297322.491525:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933059072:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297322.491603:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933059328 00000100:00100000:0.0:1789297322.491607:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933059328 00000100:00100000:0.0:1789297322.491658:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 135 00000100:00100000:0.0:1789297322.491666:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933059328:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297322.492507:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2353:x1876213933059072:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 985us (1286us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297322.492517:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00080000:3.0:1789297322.492545:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1789297322.492551:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789297322.492595:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933059328:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 929us (1227us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297322.492604:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 135 00010000:00010000:0.0:1789297322.492894:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297322.800365:0:12064:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789297322.800377:0:12064:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789297322.800420:0:12064:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:1.0:1789297322.800427:0:12064:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789297322.979307:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297322.979371:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933059584 00000100:00100000:3.0:1789297322.979383:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933059584 00000100:00100000:3.0:1789297322.979697:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:3.0:1789297322.979741:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+17:10489:x1876213933059584:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297322.979764:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297322.979783:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0ba01 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da03 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297322.979891:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0ba08 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297322.979905:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0ba08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297322.979918:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0ba08 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297322.979929:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00010000:00010000:3.0:1789297322.980076:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0ba01 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da03 expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297322.980112:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0ba08 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da03 expref: 19 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297322.980120:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297322.980123:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789297322.980126:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f000, rc 0) 00000100:00100000:3.0:1789297322.980187:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+19:10489:x1876213933059584:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 451us (889us total) trans 4294967363 rc 0/0 00000100:00100000:3.0:1789297322.980194:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:3.0:1789297322.987096:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297322.988903:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933059712 00000100:00100000:0.0:1789297322.988922:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933059712 00000100:00100000:0.0:1789297322.988995:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:0.0:1789297322.989007:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+19:10489:x1876213933059712:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:0.0:1789297322.989098:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.989118:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.989130:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.989146:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990311:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990326:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990799:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990822:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990831:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789297322.990878:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990894:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990900:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990907:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990912:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297322.990916:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990924:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990937:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297322.990940:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297322.990943:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990949:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0ba16 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990976:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990983:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990988:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.990993:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297322.990996:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991003:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991011:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b15d3a100) 00010000:00010000:0.0:1789297322.991014:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297322.991016:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991022:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba1d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991038:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991044:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991049:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991061:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bae00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297322.991064:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991071:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991079:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297322.991082:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297322.991085:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297322.991090:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0ba24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297322.992146:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+19:10489:x1876213933059712:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 3130us (5049us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297322.992171:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:2.0:1789297323.067184:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.067228:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933059968 00000100:00100000:2.0:1789297323.067245:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933059968 00000100:00100000:2.0:1789297323.067309:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00100000:2.0:1789297323.067316:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+19:10492:x1876213933059968:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297323.067334:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297323.067351:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba2b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da0a expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067415:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067427:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067435:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067445:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067449:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067453:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067679:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067688:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067695:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297323.067732:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789297323.067826:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067831:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067836:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067840:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.067843:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067848:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067857:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297323.067859:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.067862:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067866:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba32 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067874:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067877:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067888:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067891:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.067893:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067896:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067900:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b2ac85e00) 00010000:00010000:2.0:1789297323.067902:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.067903:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067906:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba39 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067938:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba2b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 22 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067946:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 21 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.067951:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:2.0:1789297323.067952:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297323.067953:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256a00, rc 0) 00000100:00100000:2.0:1789297323.068038:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+21:10492:x1876213933059968:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 720us (865us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1789297323.068055:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00080000:2.0:1789297323.068084:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297323.077522:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297323.083571:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933060096 00000100:00100000:0.0:1789297323.083586:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933060096 00000100:00100000:0.0:1789297323.083656:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:0.0:1789297323.083666:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:10492:x1876213933060096:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:0.0:1789297323.083759:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083776:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083790:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083830:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083838:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083845:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083851:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297323.083855:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083864:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083877:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:0.0:1789297323.083879:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297323.083884:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.083891:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0ba4e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297323.085346:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:10492:x1876213933060096:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 1668us (7822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297323.085364:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:3.0:1789297323.091135:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297323.091380:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933060352 00000100:00100000:1.0:1789297323.091391:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933060352 00000100:00100000:1.0:1789297323.091452:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789297323.091462:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13012050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:10492:x1876213933060352:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789297323.091754:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13012050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+22:10492:x1876213933060352:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 292us (629us total) trans 4294967365 rc 0/0 00000100:00100000:1.0:1789297323.091762:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789297323.127215:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.127307:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933060608 00000100:00100000:2.0:1789297323.127319:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933060608 00000100:00100000:2.0:1789297323.127386:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:2.0:1789297323.127397:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+22:10012:x1876213933060608:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297323.127423:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297323.127444:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba55 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da11 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.127555:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.127572:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.127581:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.127616:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.127632:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 23 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.127647:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b2021fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957199488:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297323.127796:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b0719fa80 going to sleep for 11 seconds 00000100:00100000:1.0:1789297323.132831:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.132963:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b2021fb80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957199488:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297323.133000:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.133093:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933060736 00000100:00100000:3.0:1789297323.133100:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933060736 00010000:00010000:3.0:1789297323.133146:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 24 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.133198:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:3.0:1789297323.133208:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+24:2353:x1876213933060736:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297323.133222:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297323.133229:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 24 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.133240:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 24 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.133263:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0ba40 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da0a expref: 24 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.133437:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:3.0:1789297323.133442:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.133452:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.133459:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.133489:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297323.133543:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+23:2353:x1876213933060736:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 336us (722us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.133549:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00010000:00010000:2.0:1789297323.134369:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.134379:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297323.134399:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1789297323.134547:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba55 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.134564:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.134790:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:2.0:1789297323.134793:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297323.134796:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256000, rc 0) 00000100:00100000:2.0:1789297323.134888:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+23:10012:x1876213933060608:12345-192.168.202.43@tcp:101:bash.0 Request processed in 7491us (7684us total) trans 4294967366 rc 0/0 00000100:00100000:2.0:1789297323.134896:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:1.0:1789297323.141474:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.141910:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933060992 00000100:00100000:2.0:1789297323.141921:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933060992 00000100:00100000:2.0:1789297323.142108:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:2.0:1789297323.142119:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+23:10012:x1876213933060992:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:2.0:1789297323.142452:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.142485:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.142499:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789297323.142558:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:2.0:1789297323.142597:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a54de1d8 reply state 0000000012895881 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.142606:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:2.0:1789297323.142686:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:2.0:1789297323.142856:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+27:10012:x1876213933060992:12345-192.168.202.43@tcp:36:bash.0 Request processed in 736us (1392us total) trans 4294967369 rc 0/0 00000100:00100000:2.0:1789297323.142864:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 89 00000020:00080000:2.0:1789297323.142869:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:3.0:1789297323.146387:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00010000:00010000:1.0:1789297323.146459:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.146489:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.146498:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.146504:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297323.146509:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.146517:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.146536:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:1.0:1789297323.146539:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297323.146544:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.146549:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0ba6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297323.148040:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933061120 00000100:00100000:0.0:1789297323.148060:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933061120 00000100:00100000:1.0:1789297323.148320:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 90 00000100:00100000:1.0:1789297323.148331:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+26:10012:x1876213933061120:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789297323.148361:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297323.148385:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0ba71 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da18 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.148455:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0ba71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da18 expref: 27 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.148491:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0ba71 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da18 expref: 27 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.148513:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:1.0:1789297323.148516:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789297323.148520:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3200, rc 0) 00000100:00100000:1.0:1789297323.148637:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+27:10012:x1876213933061120:12345-192.168.202.43@tcp:101:bash.0 Request processed in 307us (2261us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297323.148644:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 90 00000100:00100000:3.0:1789297323.152426:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.152542:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933061248 00000100:00100000:2.0:1789297323.152552:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933061248 00000100:00100000:2.0:1789297323.152620:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:2.0:1789297323.152630:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:10012:x1876213933061248:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297323.152649:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297323.152670:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da1f expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297323.152721:0:11700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa682a7, atime: 0x6aa682a6, ctime: 0x6aa682a7, blocks: 0xb 00010000:00010000:2.0:1789297323.152744:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:2.0:1789297323.152749:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297323.152759:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 7 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.152794:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 7 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.152808:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257400, rc 0) 00000100:00100000:2.0:1789297323.153175:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12024050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:10012:x1876213933061248:12345-192.168.202.43@tcp:101:bash.0 Request processed in 545us (759us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297323.153183:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:3.0:1789297323.156306:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297323.156429:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933061376 00000100:00100000:0.0:1789297323.156456:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933061376 00002000:00010000:0.0:1789297323.156509:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789297323.156514:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b41ee5c00 with x1876213933061376 ext(0->18446744073709551615) 00002000:00010000:0.0:1789297323.156527:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b41ee5c00. 00000100:00100000:0.0:1789297323.156603:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:0.0:1789297323.156614:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933061376:12345-192.168.202.43@tcp:10:bash.0 00002000:00010000:0.0:1789297323.157221:0:6692:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1789297323.157227:0:6692:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1789297319 -> 1789297323 00002000:00010000:0.0:1789297323.157230:0:6692:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1789297318 -> 1789297318 00002000:00010000:0.0:1789297323.157232:0:6692:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1789297319 -> 1789297323 00002000:00010000:0.0:1789297323.157235:0:6692:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789297323.157292:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:2355:x1876213933061376:12345-192.168.202.43@tcp:10:bash.0 Request processed in 678us (994us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789297323.157300:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00002000:00010000:0.0:1789297323.157304:0:6692:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1789297323.157306:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b41ee5c00 with x1876213933061376 ext(0->18446744073709551615) 00002000:00010000:0.0:1789297323.157311:0:6692:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b41ee5c00. 00000100:00100000:0.0:1789297323.216814:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.217016:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933061504 00000100:00100000:2.0:1789297323.217028:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933061504 00000100:00100000:2.0:1789297323.217090:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:2.0:1789297323.217103:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+27:10506:x1876213933061504:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789297323.217351:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217365:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217375:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217386:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217391:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217395:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217597:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217606:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217614:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297323.217650:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217658:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217663:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217667:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217671:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.217674:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217679:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217746:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297323.217751:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.217756:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217767:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0ba7f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217782:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217788:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217794:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217797:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.217800:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217803:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217808:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b2ac85100) 00010000:00010000:2.0:1789297323.217810:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.217811:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217815:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba86 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217824:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217828:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217836:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217839:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.217841:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217844:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217848:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:2.0:1789297323.217850:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.217851:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.217854:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba8d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.218134:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40952a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+27:10506:x1876213933061504:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 1031us (1323us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.218142:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:1.0:1789297323.238469:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.238529:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933061760 00000100:00100000:2.0:1789297323.238538:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933061760 00000100:00100000:2.0:1789297323.238600:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:2.0:1789297323.238612:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+27:10509:x1876213933061760:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297323.238635:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297323.238656:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba94 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da26 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.238771:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.238784:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.238804:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.238814:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.238819:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.238823:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239063:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0baa9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239073:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0baa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239080:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0baa9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297323.239091:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1789297323.239189:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239196:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239202:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239208:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.239224:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239232:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297323.239247:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.239251:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239257:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0ba9b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239267:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239286:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239291:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239296:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.239299:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239305:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239313:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b2ac85100) 00010000:00010000:2.0:1789297323.239316:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.239323:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239327:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0baa2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239360:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0ba94 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da26 expref: 30 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239369:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0baa9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da26 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.239374:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:2.0:1789297323.239375:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1789297323.239377:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257200, rc 0) 00000100:00100000:2.0:1789297323.239431:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+29:10509:x1876213933061760:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 823us (970us total) trans 4294967370 rc 0/0 00000100:00100000:2.0:1789297323.239439:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:1.0:1789297323.241434:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.241482:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933061888 00000100:00100000:3.0:1789297323.241492:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933061888 00000100:00100000:3.0:1789297323.241550:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 93 00000100:00100000:3.0:1789297323.241557:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+29:10509:x1876213933061888:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:3.0:1789297323.241621:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.241647:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.241654:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.241881:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.241893:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 29 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.241904:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957199616:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297323.242092:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b055ebd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789297323.244081:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957199616:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297323.244128:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297323.244334:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.244390:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933062144 00000100:00100000:2.0:1789297323.244398:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933062144 00000100:00100000:2.0:1789297323.244452:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:2.0:1789297323.244462:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+30:5594:x1876213933062144:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789297323.244961:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+31:5594:x1876213933062144:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 497us (625us total) trans 4294967371 rc 0/0 00000100:00100000:2.0:1789297323.244981:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:0.0:1789297323.246618:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.246821:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933062272 00000100:00100000:3.0:1789297323.246829:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933062272 00010000:00010000:3.0:1789297323.246864:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 31 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.246895:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:3.0:1789297323.246901:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+31:2353:x1876213933062272:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297323.246912:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297323.246929:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 31 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.246940:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 31 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.246963:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0ba5c lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da11 expref: 31 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.246992:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:3.0:1789297323.246998:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.247007:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.247014:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.247082:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297323.247133:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40952680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+30:2353:x1876213933062272:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 231us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.247140:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00010000:00010000:0.0:1789297323.247471:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.247480:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.247514:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.247531:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.247538:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.249892:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297323.249899:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.249908:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.249923:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:0.0:1789297323.249925:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297323.249928:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.249933:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297323.250062:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+29:10509:x1876213933061888:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 8498us (8630us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297323.250071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 93 00000100:00100000:0.0:1789297323.251659:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.251847:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933062528 00000100:00100000:2.0:1789297323.251856:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933062528 00000100:00100000:2.0:1789297323.251901:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:2.0:1789297323.251910:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+29:10509:x1876213933062528:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789297323.252200:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+30:10509:x1876213933062528:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 290us (547us total) trans 4294967372 rc 0/0 00000100:00100000:2.0:1789297323.252208:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:2.0:1789297323.310477:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297323.310545:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933062784 00000100:00100000:1.0:1789297323.310556:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933062784 00000100:00100000:1.0:1789297323.310629:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:1.0:1789297323.310642:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+30:10520:x1876213933062784:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:1.0:1789297323.310669:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297323.310699:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0babe lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da2d expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.310806:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.310821:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.310833:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.310860:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.310869:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.310877:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311167:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311176:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311183:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297323.311193:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:1.0:1789297323.311283:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311291:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311297:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311303:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297323.311307:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311326:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311340:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:1.0:1789297323.311343:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297323.311348:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311354:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bac5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311369:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311376:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311381:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311386:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297323.311389:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311394:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311400:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b08585500) 00010000:00010000:1.0:1789297323.311402:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297323.311405:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311419:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bacc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311462:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0babe lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da2d expref: 33 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311474:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da2d expref: 32 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.311481:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:1.0:1789297323.311484:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297323.311486:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3600, rc 0) 00000100:00100000:1.0:1789297323.311672:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+32:10520:x1876213933062784:12345-192.168.202.43@tcp:101:cat.0 Request processed in 1032us (1205us total) trans 4294967373 rc 0/0 00000100:00100000:1.0:1789297323.311680:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:1.0:1789297323.317564:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.317652:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933063040 00000100:00100000:3.0:1789297323.317662:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933063040 00000100:00100000:3.0:1789297323.317752:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:3.0:1789297323.317762:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+32:10520:x1876213933063040:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:3.0:1789297323.318011:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+33:10520:x1876213933063040:12345-192.168.202.43@tcp:35:cat.0 Request processed in 249us (456us total) trans 4294967374 rc 0/0 00000100:00100000:3.0:1789297323.318037:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789297323.337291:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.337493:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933063296 00000100:00100000:3.0:1789297323.337504:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933063296 00000100:00100000:3.0:1789297323.337610:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:3.0:1789297323.337623:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+33:10521:x1876213933063296:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:3.0:1789297323.337693:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789297323.337751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da2d expref: 33 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337778:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0baa9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da26 expref: 32 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337790:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0ba71 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da18 expref: 31 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337799:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:3.0:1789297323.337810:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297323.337831:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337845:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337855:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337871:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337896:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.337903:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.338353:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.338363:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.338370:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789297323.339235:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:3.0:1789297323.339246:0:5842:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 335213541944ns, next at 336213539220ns, rc = 0 00010000:00010000:3.0:1789297323.339312:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339326:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339335:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339343:0:5842:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339350:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339366:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339509:0:5842:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297323.339533:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339539:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339545:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339551:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297323.339556:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339628:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339642:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073700) 00010000:00010000:3.0:1789297323.339645:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:3.0:1789297323.339650:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339656:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0baef lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339674:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339680:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339769:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339774:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148ea00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297323.339777:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339784:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339793:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297323.339796:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297323.339799:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.339805:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bae1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297323.339816:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000cbaba99a reply state 00000000561e6011 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.339825:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297323.339928:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+32:10521:x1876213933063296:12345-192.168.202.43@tcp:36:rm.0 Request processed in 2304us (2643us total) trans 4294967375 rc 0/0 00000100:00100000:3.0:1789297323.340133:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 95 00010000:00010000:2.0:1789297323.342082:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297323.342099:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342112:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297323.342117:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342127:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342144:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff982b03073700) 00010000:00010000:2.0:1789297323.342147:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789297323.342151:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342157:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0baf6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342187:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297323.342190:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297323.342191:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297323.342227:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342235:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342256:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342262:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.342265:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342271:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342281:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b03073800) 00010000:00010000:2.0:1789297323.342283:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.342286:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.342292:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0bae8 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297323.383222:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.383431:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933063552 00000100:00100000:2.0:1789297323.383443:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933063552 00000100:00100000:2.0:1789297323.383506:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 96 00000100:00100000:2.0:1789297323.383516:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+31:10527:x1876213933063552:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297323.383541:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297323.383561:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bafd lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da34 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.383699:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.383761:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.383772:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.383786:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.383793:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.383799:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789297323.384756:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:2.0:1789297323.384943:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.384956:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.384972:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385009:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385016:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385023:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385038:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.385043:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385051:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385066:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297323.385069:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297323.385073:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385079:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb04 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297323.385093:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e65f336f reply state 00000000268d0d42 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.385102:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789297323.385134:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bafd lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385147:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 33 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.385165:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:2.0:1789297323.385168:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297323.385170:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256600, rc 0) 00000100:00100000:2.0:1789297323.385244:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+34:10527:x1876213933063552:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1730us (2033us total) trans 4294967376 rc 0/0 00000100:00100000:2.0:1789297323.385258:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 96 00010000:00010000:1.0:1789297323.391501:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.391521:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.391529:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.391535:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297323.391540:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.391577:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.391594:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b2ac85100) 00010000:00010000:1.0:1789297323.391597:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297323.391602:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.391609:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bb0b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297323.394110:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.394322:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933063680 00000100:00100000:3.0:1789297323.394334:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933063680 00000100:00100000:3.0:1789297323.394401:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:3.0:1789297323.394412:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2356:x1876213933063680:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789297323.394450:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297323.394476:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da3b expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789297323.394508:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789297323.394528:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=335s v=(0 0) 00010000:00010000:3.0:1789297323.394533:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297323.394543:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.394563:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 6 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.394583:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148ea00, rc 0) 00000100:00100000:3.0:1789297323.394652:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2356:x1876213933063680:12345-192.168.202.43@tcp:101:bash.0 Request processed in 242us (553us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.394659:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:3.0:1789297323.397897:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297323.398081:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933063808 00000100:00100000:1.0:1789297323.398095:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933063808 00000100:00100000:1.0:1789297323.398171:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:1.0:1789297323.398181:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:10527:x1876213933063808:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789297323.398203:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297323.398223:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da42 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.398255:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.398264:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297323.398268:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297323.398274:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.398309:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 7 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.398339:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 7 pid: 6688 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297323.398355:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1876213957199744:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297323.398461:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0180 going to sleep for 11 seconds 00000100:00100000:0.0:1789297323.401083:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.401323:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933063936 00000100:00100000:2.0:1789297323.401335:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933063936 00010000:00010000:2.0:1789297323.401383:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 8 pid: 6688 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.401431:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:2.0:1789297323.401441:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933063936:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297323.401456:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297323.401483:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 8 pid: 6688 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.401497:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 8 pid: 6688 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.401527:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297323.401532:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297323.401540:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.401550:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.401600:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.401635:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b2021c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1876213957199872:192.168.202.43@tcp:105: 00000100:00100000:2.0:1789297323.401761:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b0719f300 going to sleep for 11 seconds 00010000:00010000:1.0:1789297323.401904:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000df44e83b/0x8ad177e823a0bb20 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da3b expref: 8 pid: 6688 timeout: 435 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297323.401924:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1876213957199744:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297323.401972:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.401983:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2400, rc 0) 00000100:00100000:1.0:1789297323.402015:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:10527:x1876213933063808:12345-192.168.202.43@tcp:101:bash.0 Request processed in 3835us (4131us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297323.402022:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:0.0:1789297323.406082:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.406329:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b2021c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5826:1876213957199872:192.168.202.43@tcp:105: 00010000:00010000:2.0:1789297323.406355:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297323.406416:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3cc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933063936:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 4975us (5345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297323.406428:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:3.0:1789297323.406593:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933064192 00000100:00100000:3.0:1789297323.406600:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933064192 00000100:00100000:3.0:1789297323.406657:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:3.0:1789297323.406670:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+33:10527:x1876213933064192:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:3.0:1789297323.407452:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+34:10527:x1876213933064192:12345-192.168.202.43@tcp:35:bash.0 Request processed in 779us (1379us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1789297323.407462:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:3.0:1789297323.500132:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.500190:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297323.500276:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933064448 00000100:00100000:1.0:1789297323.500288:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933064448 00000100:00100000:1.0:1789297323.500351:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:1.0:1789297323.500363:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933064448:12345-192.168.202.43@tcp:16:kworker.0 00000100:00100000:1.0:1789297323.500504:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38290a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933064448:12345-192.168.202.43@tcp:16:kworker.0 Request processed in 143us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297323.500511:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:2.0:1789297323.500732:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933064320 00000100:00100000:2.0:1789297323.500737:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933064320 00002000:00100000:2.0:1789297323.500769:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff982b38292300 x1876213933064320/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:184/0 lens 504/0 e 0 to 0 dl 1789297334 ref 1 fl New:/600/ffffffff rc 0/-1 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789297323.500780:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b38292300 with x1876213933064320 ext(0->8) 00002000:00010000:2.0:1789297323.500786:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982b38292300 00000100:00100000:2.0:1789297323.500811:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:2.0:1789297323.500819:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933064320:12345-192.168.202.43@tcp:4:bash.0 00000100:00100000:2.0:1789297323.501325:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38292300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2355:x1876213933064320:12345-192.168.202.43@tcp:4:bash.0 Request processed in 505us (1204us total) trans 4294967302 rc 0/0 00000100:00100000:2.0:1789297323.501333:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00002000:00100000:2.0:1789297323.501340:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff982b38292300 x1876213933064320/t4294967302(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:184/0 lens 504/448 e 0 to 0 dl 1789297334 ref 1 fl Complete:/600/0 rc 0/0 job:'bash.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789297323.501348:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b38292300 with x1876213933064320 ext(0->8) 00002000:00010000:2.0:1789297323.501352:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 0 locks timeout for req ffff982b38292300 00010000:00010000:0.0:1789297323.518937:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789297323.549666:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967300 is committed 00000001:00080000:1.0:1789297323.549721:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967301 is committed 00000100:00100000:0.0:1789297323.594521:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.594635:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933064576 00000100:00100000:3.0:1789297323.594648:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933064576 00000100:00100000:3.0:1789297323.594760:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:3.0:1789297323.594771:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+34:10543:x1876213933064576:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297323.594796:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297323.594818:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb2e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da49 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.594890:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bb35 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.594905:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bb35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.594916:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bb35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297323.594952:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:3.0:1789297323.594957:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297323.594990:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bb35 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.595016:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb2e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da49 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.595036:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bb35 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da49 expref: 35 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.595067:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297323.595070:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297323.595075:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fe00, rc 0) 00000100:00100000:3.0:1789297323.595137:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40952d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+35:10543:x1876213933064576:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 367us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.595144:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:0.0:1789297323.601264:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297323.601841:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933064832 00000100:00100000:1.0:1789297323.601853:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933064832 00000100:00100000:1.0:1789297323.601922:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:1.0:1789297323.601934:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+35:10543:x1876213933064832:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297323.601957:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297323.601990:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bb3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da50 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.602101:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bb43 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.602116:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bb43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.602129:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bb43 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297323.602141:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1789297323.602301:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bb3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da50 expref: 38 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.602322:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bb43 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da50 expref: 37 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.602329:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:1.0:1789297323.602332:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297323.602336:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2200, rc 0) 00000100:00100000:1.0:1789297323.602402:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40953480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+37:10543:x1876213933064832:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 471us (1148us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1789297323.602423:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:0.0:1789297323.607080:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.607300:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933065088 00000100:00100000:2.0:1789297323.607311:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933065088 00000100:00100000:2.0:1789297323.607375:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:2.0:1789297323.607388:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+37:10543:x1876213933065088:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297323.607418:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297323.607441:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb51 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da57 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.607887:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bb58 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.607903:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.607915:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bb58 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297323.607928:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789297323.608077:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb51 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da57 expref: 40 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.608097:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bb58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da57 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.608106:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:2.0:1789297323.608109:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789297323.608113:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257c00, rc 0) 00000100:00100000:2.0:1789297323.608555:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40952680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+39:10543:x1876213933065088:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1156us (1474us total) trans 4294967379 rc 0/0 00000100:00100000:2.0:1789297323.608591:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:0.0:1789297323.611557:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.612331:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933065216 00000100:00100000:3.0:1789297323.612343:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933065216 00000100:00100000:3.0:1789297323.612414:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789297323.612423:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+39:2353:x1876213933065216:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297323.612437:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297323.612462:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bb43 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da50 expref: 39 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.612482:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:3.0:1789297323.612487:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297323.612767:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621e680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+38:2353:x1876213933065216:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 344us (1231us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.612775:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:1.0:1789297323.620955:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.621046:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933065344 00000100:00100000:2.0:1789297323.621058:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933065344 00000100:00100000:2.0:1789297323.621128:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:2.0:1789297323.621140:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+8:2355:x1876213933065344:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:2.0:1789297323.621191:0:11700:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.621214:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.621223:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297323.621227:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297323.621233:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.621282:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.621298:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 8 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.621315:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b2021d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11700:1876213957200000:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297323.621415:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b183956c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297323.624233:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b2021d880 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11700:1876213957200000:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297323.624264:0:11700:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297323.626090:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.626493:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933065472 00000100:00100000:3.0:1789297323.626503:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933065472 00010000:00010000:3.0:1789297323.626553:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.626597:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:3.0:1789297323.626618:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:2354:x1876213933065472:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297323.626635:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1789297323.626658:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1789297323.626660:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1789297323 00002000:00010000:3.0:1789297323.626663:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1789297323 00010000:00010000:3.0:1789297323.626669:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.626682:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.626742:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f68769c2/0x8ad177e823a0bb27 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da42 expref: 9 pid: 6687 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.626760:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789297323.626764:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789297323.626770:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.626779:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.626810:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297323.626858:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933065472:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 241us (777us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.626866:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00010000:00010000:1.0:1789297323.627367:0:11700:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627379:0:11700:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627403:0:11700:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627411:0:11700:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627419:0:11700:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627425:0:11700:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297323.627430:0:11700:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627450:0:11700:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627464:0:11700:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.627472:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ec425883/0x8ad177e823a0bb66 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297323.627552:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933065344:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 6413us (6607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297323.627566:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:1.0:1789297323.631367:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.631507:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933065728 00000100:00100000:2.0:1789297323.631528:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933065728 00000100:00100000:2.0:1789297323.631599:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:2.0:1789297323.631608:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13012c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+38:10543:x1876213933065728:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:2.0:1789297323.631677:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bb58 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da57 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789297323.631977:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:2.0:1789297323.632027:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:2.0:1789297323.632398:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:2.0:1789297323.632457:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.632475:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.632487:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.632524:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 42 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.632539:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 42 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.632553:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b2021c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876213957200128:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297323.632633:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b183956c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297323.638059:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297323.638230:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933065856 00000100:00100000:1.0:1789297323.638241:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933065856 00010000:00010000:1.0:1789297323.638292:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 43 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297323.638334:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:1.0:1789297323.638346:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+43:2354:x1876213933065856:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297323.638360:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297323.638368:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 43 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.638381:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 43 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.638423:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:1.0:1789297323.638429:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.638439:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.638446:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.638466:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297323.638532:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+43:2354:x1876213933065856:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 188us (486us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297323.638540:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00010000:00010000:3.0:1789297323.640190:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bb12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da34 expref: 42 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.640215:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b2021c700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876213957200128:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297323.640237:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.640246:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.640251:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297323.640390:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:3.0:1789297323.640594:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:3.0:1789297323.640998:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e68700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957200256:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1789297323.641064:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297323.641092:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b2a645840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297323.641257:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957200256 00000100:00100000:0.0:1789297323.641275:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957200256 00000100:00100000:0.0:1789297323.641340:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789297323.641351:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957200256:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789297323.641442:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957200256:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (377us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297323.641449:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789297323.641727:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297323.641997:0:5846:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967301 gen 2 00000004:00080000:1.0:1789297323.642004:0:5846:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967301 00000004:00080000:1.0:1789297323.642027:0:5846:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b40953b80, transno 4294967301 00000100:00100000:1.0:1789297323.642048:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e68700 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957200256:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:1.0:1789297323.644530:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1789297323.645246:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957200384:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789297323.645381:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297323.645464:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b540 going to sleep for 11 seconds 00000100:00100000:2.0:1789297323.645513:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957200384 00000100:00100000:2.0:1789297323.645531:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957200384 00000100:00100000:2.0:1789297323.645900:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297323.645910:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957200384:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789297323.646138:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5846:x1876213957200384:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 229us (756us total) trans 4294967303 rc 0/0 00000100:00100000:2.0:1789297323.646146:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1789297323.646236:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957200384:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1789297323.646307:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1789297323.646356:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.646367:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.646376:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.646382:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297323.646387:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.646407:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.646423:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:0.0:1789297323.646426:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1789297323.646430:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.646436:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bb6d lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1789297323.646644:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1789297323.646780:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1789297323.646792:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 335521087208ns, next at 336521084920ns, rc = 0 00000001:00080000:0.0:1789297323.646798:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1789297323.646830:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:0.0:1789297323.646833:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1789297323.646840:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bb58 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da57 expref: 46 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297323.646951:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13012c50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+45:10543:x1876213933065728:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 15343us (15595us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1789297323.646959:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000020:00080000:0.0:1789297323.646973:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1789297323.651414:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297323.651520:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933065984 00000100:00100000:1.0:1789297323.651531:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933065984 00000100:00100000:0.0:1789297323.652032:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:0.0:1789297323.652049:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+45:10543:x1876213933065984:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297323.652076:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297323.652114:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0bb74 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da5e expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.652177:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0bb74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da5e expref: 46 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.652194:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0bb74 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da5e expref: 46 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.652215:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297323.652218:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297323.652222:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bae00, rc 0) 00000100:00100000:0.0:1789297323.652327:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+46:10543:x1876213933065984:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 284us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297323.652334:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:1.0:1789297323.656511:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.657066:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933066240 00000100:00100000:3.0:1789297323.657079:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933066240 00000100:00100000:3.0:1789297323.657137:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:3.0:1789297323.657147:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+46:10543:x1876213933066240:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297323.657943:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+47:10543:x1876213933066240:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 794us (1439us total) trans 4294967389 rc 0/0 00000100:00100000:3.0:1789297323.657952:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:1.0:1789297323.762104:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.762261:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933066368 00000100:00100000:3.0:1789297323.762343:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933066368 00000100:00100000:3.0:1789297323.762410:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 101 00000100:00100000:3.0:1789297323.762421:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+47:10553:x1876213933066368:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:3.0:1789297323.762523:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.762644:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.762660:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.762676:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.762897:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.762906:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763009:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763018:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763024:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297323.763070:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763083:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763099:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763106:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763113:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297323.763118:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763125:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763139:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:3.0:1789297323.763142:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297323.763146:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763330:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bb7b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763346:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763352:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763358:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763363:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297323.763372:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763378:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763387:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b03073a00) 00010000:00010000:3.0:1789297323.763390:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297323.763393:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763399:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bb82 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763419:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763425:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763431:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763435:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297323.763439:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763445:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763451:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:3.0:1789297323.763454:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297323.763462:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.763467:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bb89 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.763701:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+47:10553:x1876213933066368:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 1277us (1607us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.763749:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 101 00000100:00100000:2.0:1789297323.806378:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297323.806501:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933066624 00000100:00100000:0.0:1789297323.806513:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933066624 00000100:00100000:0.0:1789297323.806593:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 102 00000100:00100000:0.0:1789297323.806604:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+47:10556:x1876213933066624:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297323.806625:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297323.806648:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bb90 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da65 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.806930:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.806947:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.806987:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.807003:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.807011:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.807017:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.807141:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.807151:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.808241:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297323.808255:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1789297323.808907:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.808917:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.808926:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.808932:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297323.808947:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.808955:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.808980:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297323.808983:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297323.808988:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.808994:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bb97 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809009:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809015:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809021:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809027:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297323.809030:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809035:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809041:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b15d3a100) 00010000:00010000:0.0:1789297323.809043:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297323.809051:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809057:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bb9e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809106:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bb90 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809119:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.809126:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297323.809129:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297323.809131:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb200, rc 0) 00000100:00100000:0.0:1789297323.809993:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+49:10556:x1876213933066624:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 3385us (3620us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1789297323.810003:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 102 00000100:00100000:1.0:1789297323.814429:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.814523:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933066752 00000100:00100000:2.0:1789297323.814533:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933066752 00000100:00100000:2.0:1789297323.815004:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 103 00000100:00100000:2.0:1789297323.815017:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+49:10556:x1876213933066752:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789297323.815094:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815113:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815126:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815163:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815169:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815176:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815182:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297323.815201:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815209:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815221:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297323.815225:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789297323.815229:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.815235:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.815458:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+49:10556:x1876213933066752:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 443us (1037us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297323.815467:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 103 00000100:00100000:1.0:1789297323.819106:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297323.819210:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933067008 00000100:00100000:0.0:1789297323.819220:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933067008 00000100:00100000:0.0:1789297323.819369:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789297323.819381:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+49:10556:x1876213933067008:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789297323.819643:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+50:10556:x1876213933067008:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 264us (546us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1789297323.819651:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789297323.918566:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.918744:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933067264 00000100:00100000:2.0:1789297323.918756:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933067264 00000100:00100000:2.0:1789297323.919135:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:2.0:1789297323.919149:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+50:10566:x1876213933067264:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297323.919177:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297323.919181:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789297323.919212:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bb35 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da49 expref: 50 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.919235:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297323.919240:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789297323.919255:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbba lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da6c expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.919383:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.919398:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.919407:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.919444:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 50 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.919459:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 50 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.919473:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b2021ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957200512:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297323.919577:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395780 going to sleep for 11 seconds 00000100:00100000:1.0:1789297323.923443:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.923551:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b2021ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957200512:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297323.924687:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933067392 00000100:00100000:3.0:1789297323.924717:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933067392 00010000:00010000:3.0:1789297323.925120:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 51 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.925177:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:3.0:1789297323.925188:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+51:2354:x1876213933067392:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297323.925210:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297323.925217:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 51 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.925239:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 51 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.925264:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bba5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da65 expref: 51 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.925282:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:3.0:1789297323.925288:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.925317:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.925326:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.925350:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297323.925418:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259d880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+50:2354:x1876213933067392:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 231us (1985us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297323.925426:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00010000:00010000:2.0:1789297323.926213:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.926228:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.926235:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297323.926254:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:2.0:1789297323.926421:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbba lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 51 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.926440:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 50 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.926448:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297323.926451:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297323.926454:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256000, rc 0) 00000100:00100000:2.0:1789297323.926499:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+50:10566:x1876213933067264:12345-192.168.202.43@tcp:101:bash.0 Request processed in 7355us (7947us total) trans 4294967392 rc 0/0 00000100:00100000:2.0:1789297323.926507:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:1.0:1789297323.929050:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297323.929356:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933067648 00000100:00100000:3.0:1789297323.929368:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933067648 00000100:00100000:3.0:1789297323.929461:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 105 00000100:00100000:3.0:1789297323.929472:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+50:10566:x1876213933067648:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:3.0:1789297323.930317:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.930337:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.930349:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297323.930407:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:3.0:1789297323.930434:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a7cd4a3e reply state 0000000056e31a0b transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297323.930441:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297323.930551:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+53:10566:x1876213933067648:12345-192.168.202.43@tcp:36:bash.0 Request processed in 1079us (1890us total) trans 4294967394 rc 0/0 00000100:00100000:3.0:1789297323.931004:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 105 00000020:00080000:3.0:1789297323.931010:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789297323.936976:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297323.937045:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933067776 00000100:00100000:0.0:1789297323.937058:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933067776 00000100:00100000:0.0:1789297323.937175:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 106 00000100:00100000:0.0:1789297323.937188:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+53:10566:x1876213933067776:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789297323.937209:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.937216:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297323.937222:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.937229:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.937235:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297323.937236:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bbd6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da73 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.937240:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.937248:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.937266:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:3.0:1789297323.937269:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297323.937273:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297323.937278:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bbcf lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.937321:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.937342:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 53 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.937350:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.937387:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 53 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297323.937401:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 53 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297323.937413:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957200640:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297323.937497:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4bcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297323.941939:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.942195:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933067904 00000100:00100000:0.0:1789297323.942196:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621e300 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957200640:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297323.942203:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933067904 00010000:00010000:0.0:1789297323.942229:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.942245:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 54 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297323.942284:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:2.0:1789297323.942295:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+54:2353:x1876213933067904:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297323.942312:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297323.942318:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 54 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.942330:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 54 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.942357:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbc1 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da6c expref: 54 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.942394:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297323.942399:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.942409:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.942417:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297323.942454:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297323.942521:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+53:2353:x1876213933067904:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 227us (592us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297323.942528:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00010000:00010000:1.0:1789297323.943570:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.943589:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297323.943643:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789297323.943648:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297323.944091:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.944138:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bbd6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.944157:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297323.944166:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297323.944168:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297323.944171:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba200, rc 0) 00000100:00100000:1.0:1789297323.944234:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+52:10566:x1876213933067776:12345-192.168.202.43@tcp:101:bash.0 Request processed in 7048us (7279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297323.944243:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 106 00000100:00100000:1.0:1789297323.950548:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297323.950649:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933068160 00000100:00100000:2.0:1789297323.950670:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933068160 00000100:00100000:0.0:1789297323.951431:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:0.0:1789297323.951463:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+52:10566:x1876213933068160:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:0.0:1789297323.952115:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+53:10566:x1876213933068160:12345-192.168.202.43@tcp:35:bash.0 Request processed in 655us (1576us total) trans 4294967395 rc 0/0 00000100:00100000:0.0:1789297323.952125:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:0.0:1789297324.065279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.065438:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933068288 00000100:00100000:2.0:1789297324.065448:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933068288 00000100:00100000:2.0:1789297324.065560:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 107 00000100:00100000:2.0:1789297324.065572:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+53:10572:x1876213933068288:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297324.065597:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297324.065618:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbe4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da7a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.065685:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbeb lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.065698:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.065761:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297324.065796:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 16384 00000004:00200000:2.0:1789297324.065800:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297324.065818:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbeb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.065844:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bbe4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da7a expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.065863:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbeb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da7a expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.065872:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297324.065875:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297324.065878:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257200, rc 0) 00000100:00100000:2.0:1789297324.066040:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+54:10572:x1876213933068288:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 469us (769us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.066061:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 107 00000100:00100000:1.0:1789297324.077602:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.078014:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933068416 00000100:00100000:2.0:1789297324.078026:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933068416 00000100:00100000:0.0:1789297324.079842:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 108 00000100:00100000:0.0:1789297324.081528:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+54:10572:x1876213933068416:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297324.081565:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297324.081586:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bbf2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da81 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081650:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081663:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081675:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081688:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081695:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081720:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081819:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081828:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081834:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297324.081869:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:0.0:1789297324.081873:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297324.081888:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081900:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081908:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081915:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081921:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081927:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297324.081931:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081938:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081956:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:0.0:1789297324.081969:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297324.081974:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081981:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bbf9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.081994:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082000:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082006:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082011:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297324.082014:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082019:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082026:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b15d3a100) 00010000:00010000:0.0:1789297324.082028:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297324.082030:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082036:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc00 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082254:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bbf2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 56 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082268:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.082276:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297324.082278:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297324.082280:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb000, rc 0) 00000100:00100000:0.0:1789297324.082424:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+55:10572:x1876213933068416:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 915us (4831us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297324.082431:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 108 00000100:00100000:1.0:1789297324.091498:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297324.091589:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933068672 00000100:00100000:3.0:1789297324.091600:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933068672 00000100:00100000:3.0:1789297324.091665:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 109 00000100:00100000:3.0:1789297324.091677:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+55:10572:x1876213933068672:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297324.091752:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297324.091774:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bc0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da88 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.091877:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.091894:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.091904:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 56 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.091913:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 5/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.091951:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 56 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.091979:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 56 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.091992:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e68700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957200768:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297324.092397:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.092407:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 56 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297324.092417:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40951500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957200896:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297324.092445:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304300 going to sleep for 11 seconds 00000100:00100000:1.0:1789297324.101272:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.101316:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.101618:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e68700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957200768:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297324.101634:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40951500 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957200896:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297324.101664:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.101867:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933068928 00000100:00100000:3.0:1789297324.101874:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933068928 00010000:00010000:3.0:1789297324.101903:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 57 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.101931:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933068800 00000100:00100000:3.0:1789297324.101941:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933068800 00010000:00010000:3.0:1789297324.101955:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 58 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.101989:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:3.0:1789297324.101997:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+58:2355:x1876213933068928:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297324.102011:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297324.102017:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 58 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.102026:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 58 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.102064:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bbdd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da73 expref: 58 pid: 5843 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.102080:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:3.0:1789297324.102085:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.102093:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.102099:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297324.102137:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:1.0:1789297324.102153:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+57:2356:x1876213933068800:12345-192.168.202.43@tcp:103:ldlm_bl.0 00000100:00100000:3.0:1789297324.102154:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+57:2355:x1876213933068928:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 158us (893us total) trans 0 rc 0/0 00010000:00010000:1.0:1789297324.102161:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297324.102166:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 57 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102176:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 57 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102189:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0bc07 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da81 expref: 57 pid: 7920 timeout: 435 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102200:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297324.102203:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102211:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102219:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102240:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297324.102259:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3d450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+56:2356:x1876213933068800:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 110us (943us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297324.102449:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:1.0:1789297324.102454:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00010000:00010000:1.0:1789297324.102499:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102506:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297324.102531:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1789297324.102685:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bc0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102701:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.102881:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297324.102883:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789297324.102886:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f800, rc 0) 00000100:00100000:1.0:1789297324.102914:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+55:10572:x1876213933068672:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 11239us (11427us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1789297324.102921:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 109 00000100:00100000:0.0:1789297324.113256:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.113591:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933069184 00000100:00100000:2.0:1789297324.113603:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933069184 00000100:00100000:2.0:1789297324.113737:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:2.0:1789297324.113748:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+55:10572:x1876213933069184:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:2.0:1789297324.113765:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297324.113805:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0bb74 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da5e expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.113823:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297324.113827:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297324.113885:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+54:10572:x1876213933069184:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 139us (638us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.113892:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789297324.116593:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.116779:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933069312 00000100:00100000:1.0:1789297324.116788:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933069312 00000100:00100000:1.0:1789297324.116835:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 110 00000100:00100000:1.0:1789297324.116842:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+54:10572:x1876213933069312:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:1.0:1789297324.116954:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.116980:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.116992:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789297324.117170:0:5843:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:1.0:1789297324.117263:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e68700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+54:10572:x1876213933069312:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 419us (677us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.117271:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 110 00000100:00100000:1.0:1789297324.119872:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.120019:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933069440 00000100:00100000:2.0:1789297324.120027:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933069440 00000100:00100000:2.0:1789297324.120113:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 111 00000100:00100000:2.0:1789297324.120125:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+54:10572:x1876213933069440:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297324.120145:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297324.120165:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da8f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.120218:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.120226:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.120247:0:5842:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.120256:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.120265:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297324.120284:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789297324.120288:0:5842:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.120293:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256000, rc 0) 00000100:00100000:2.0:1789297324.120337:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+55:10572:x1876213933069440:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 215us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.120344:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 111 00000040:00080000:0.0:1789297324.221045:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789297324.221057:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789297324.221243:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1789297324.221251:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789297324.221400:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40950700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957201024:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789297324.221583:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297324.225845:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.225969:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40950700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957201024:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789297324.226202:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933069568 00000100:00100000:2.0:1789297324.226210:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933069568 00000100:00100000:2.0:1789297324.226265:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 112 00000100:00100000:2.0:1789297324.226275:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+55:10574:x1876213933069568:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789297324.226304:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789297324.230615:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+55:10574:x1876213933069568:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 4325us (4764us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.230630:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 112 00000100:00100000:3.0:1789297324.234631:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.234825:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933069696 00000100:00100000:1.0:1789297324.234836:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933069696 00000100:00100000:1.0:1789297324.234899:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 113 00000100:00100000:1.0:1789297324.234910:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+55:10574:x1876213933069696:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789297324.234991:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235008:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235022:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235109:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235118:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235125:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235150:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235158:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235186:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297324.235229:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789297324.235234:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297324.235248:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235260:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235266:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235274:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235279:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.235284:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235291:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235305:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:1.0:1789297324.235308:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297324.235312:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235319:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bc31 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235344:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235350:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235356:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235361:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.235364:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235370:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235376:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff982b08585f00) 00010000:00010000:1.0:1789297324.235379:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297324.235382:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235387:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bc38 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235400:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235406:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235412:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235424:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.235427:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235433:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235440:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297324.235443:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297324.235446:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.235452:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bc3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.235538:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+55:10574:x1876213933069696:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 629us (915us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.235546:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 113 00000100:00100000:1.0:1789297324.241987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.242161:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933069952 00000100:00100000:0.0:1789297324.242171:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933069952 00000100:00100000:0.0:1789297324.242281:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:0.0:1789297324.242293:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+55:10574:x1876213933069952:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297324.242316:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297324.242336:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc46 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da96 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242434:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242460:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242473:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297324.242483:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789297324.242589:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242610:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242617:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242624:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297324.242628:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242636:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242648:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297324.242651:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789297324.242655:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242661:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bc4d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242827:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc46 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da96 expref: 57 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242839:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:0.0:1789297324.242841:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297324.242846:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc46 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da96 expref: 57 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.242856:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba400, rc 0) 00000100:00100000:0.0:1789297324.242940:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+56:10574:x1876213933069952:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 650us (963us total) trans 4294967397 rc 301/301 00000100:00100000:0.0:1789297324.242947:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:0.0:1789297324.249192:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.249573:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933070080 00000100:00100000:1.0:1789297324.249584:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933070080 00000100:00100000:1.0:1789297324.249696:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:1.0:1789297324.249754:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+56:10574:x1876213933070080:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789297324.249800:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789297324.249914:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+56:10574:x1876213933070080:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 208us (733us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.249922:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:1.0:1789297324.254411:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297324.254524:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933070336 00000100:00100000:3.0:1789297324.254533:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933070336 00000100:00100000:2.0:1789297324.254952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:2.0:1789297324.254973:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+56:10574:x1876213933070336:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297324.254996:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297324.254999:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789297324.255027:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bbeb lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da7a expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.255044:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297324.255059:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789297324.255071:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bc5b lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57da9d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789297324.255525:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1789297324.256133:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bc62 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.256148:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.256168:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bc62 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.256222:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bc5b lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da9d expref: 58 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.256237:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bc62 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da9d expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.256245:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:2.0:1789297324.256248:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297324.256251:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256e00, rc 0) 00000100:00100000:2.0:1789297324.256314:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+57:10574:x1876213933070336:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1344us (1913us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1789297324.256322:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:0.0:1789297324.261230:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.261322:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933070592 00000100:00100000:2.0:1789297324.261333:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933070592 00000100:00100000:2.0:1789297324.261407:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:2.0:1789297324.261420:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+57:10574:x1876213933070592:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1789297324.261506:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297324.261554:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bc62 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da9d expref: 57 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261573:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:2.0:1789297324.261582:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789297324.261599:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261611:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261618:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261627:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261631:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261635:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261695:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261700:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261741:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261745:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297324.261754:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261760:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261766:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297324.261769:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297324.261772:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261776:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bc70 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261782:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261792:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261796:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261800:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297324.261801:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261804:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261808:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xc3293b34 (ffff982b2ac85f00) 00010000:00010000:2.0:1789297324.261809:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297324.261817:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.261821:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc77 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xc3293b34 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.261896:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40953b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+56:10574:x1876213933070592:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 480us (679us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789297324.261902:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:1.0:1789297324.264983:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.265179:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933070720 00000100:00100000:0.0:1789297324.265191:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933070720 00000100:00100000:0.0:1789297324.265255:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:0.0:1789297324.265266:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+56:10574:x1876213933070720:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297324.265289:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297324.265311:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc7e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57daa4 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.265343:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.265356:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.265366:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.265558:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bc7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 58 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.275306:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 57 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.275319:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:0.0:1789297324.275341:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789297324.275345:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba600, rc 0) 00000100:00100000:0.0:1789297324.275438:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+57:10574:x1876213933070720:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 10161us (10454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297324.275448:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:3.0:1789297324.288322:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.293360:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933070976 00000100:00100000:1.0:1789297324.293379:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933070976 00000100:00100000:1.0:1789297324.293465:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:1.0:1789297324.293476:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+57:10574:x1876213933070976:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789297324.293581:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.293599:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.293610:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789297324.293908:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:1.0:1789297324.294020:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000364b4a81 reply state 00000000e0bab6fa transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.294029:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789297324.294160:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+59:10574:x1876213933070976:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 683us (5846us total) trans 4294967399 rc 0/0 00000100:00100000:1.0:1789297324.294168:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:1.0:1789297324.297044:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.297183:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933071104 00000100:00100000:2.0:1789297324.297193:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933071104 00000100:00100000:2.0:1789297324.297253:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 120 00000100:00100000:2.0:1789297324.297263:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+59:10574:x1876213933071104:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297324.297286:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297324.297305:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57daab expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.297369:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.297384:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.297403:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:2.0:1789297324.297406:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789297324.297410:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257e00, rc 0) 00000100:00100000:2.0:1789297324.297645:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+60:10574:x1876213933071104:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 382us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.297653:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 120 00010000:00010000:3.0:1789297324.298066:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.298074:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.298081:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.298293:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297324.298299:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.298307:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.298322:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:3.0:1789297324.298325:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789297324.298329:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.298335:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bc8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.304087:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.307847:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933071232 00000100:00100000:1.0:1789297324.307863:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933071232 00000100:00100000:1.0:1789297324.307953:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:1.0:1789297324.307975:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933071232:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789297324.308385:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+9:2354:x1876213933071232:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 411us (4307us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1789297324.308409:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00080000:2.0:1789297324.308781:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297324.313948:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.314154:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933071488 00000100:00100000:2.0:1789297324.314168:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933071488 00000100:00100000:2.0:1789297324.314229:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:2.0:1789297324.314240:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+59:10574:x1876213933071488:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1789297324.314496:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+60:10574:x1876213933071488:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 257us (559us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1789297324.314504:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:0.0:1789297324.319100:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.319211:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933071744 00000100:00100000:1.0:1789297324.319222:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933071744 00000100:00100000:1.0:1789297324.319288:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:1.0:1789297324.319300:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+60:10574:x1876213933071744:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789297324.319420:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277df480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+60:10574:x1876213933071744:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 122us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.319427:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:3.0:1789297324.323856:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.325654:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933071872 00000100:00100000:0.0:1789297324.325670:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933071872 00000100:00100000:0.0:1789297324.325782:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:0.0:1789297324.325794:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+60:10574:x1876213933071872:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297324.325814:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297324.325834:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bc9a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dab2 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.325907:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bca1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.325922:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.325933:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297324.325999:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297324.326025:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bca1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.326052:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bc9a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab2 expref: 62 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.326092:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bca1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab2 expref: 61 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.326100:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:0.0:1789297324.326103:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789297324.326106:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba400, rc 0) 00000100:00100000:0.0:1789297324.326174:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+61:10574:x1876213933071872:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 382us (2333us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297324.326181:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 122 00000100:00100000:0.0:1789297324.332029:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.333370:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933072000 00000100:00100000:1.0:1789297324.333385:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933072000 00000100:00100000:1.0:1789297324.333453:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:1.0:1789297324.333465:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+9:2353:x1876213933072000:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297324.333483:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297324.333505:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dab9 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789297324.333536:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa682ac, blocks: 0x1 00010000:00010000:1.0:1789297324.333558:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=336s v=(0 0) 00010000:00010000:1.0:1789297324.333563:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297324.333572:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.333591:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 10 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.333627:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2400, rc 0) 00000100:00100000:1.0:1789297324.333699:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277ddc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+10:2353:x1876213933072000:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 236us (1682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.333743:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:1.0:1789297324.341565:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.341659:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933072256 00000100:00100000:0.0:1789297324.341671:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933072256 00000100:00100000:0.0:1789297324.341758:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:0.0:1789297324.341769:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+61:10574:x1876213933072256:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789297324.341882:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+61:10574:x1876213933072256:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 115us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297324.341890:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:3.0:1789297324.346224:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.346328:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933072384 00000100:00100000:2.0:1789297324.346338:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933072384 00000100:00100000:2.0:1789297324.346395:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:2.0:1789297324.346405:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+10:10574:x1876213933072384:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297324.346422:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297324.346441:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dac0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.346474:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.346483:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297324.346487:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297324.346492:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.346527:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.346559:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 11 pid: 6687 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.346575:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b2021ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957201152:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297324.346674:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b183959c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297324.350672:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.350821:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933072512 00000100:00100000:1.0:1789297324.350831:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933072512 00010000:00010000:1.0:1789297324.350873:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 12 pid: 6687 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.350921:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:1.0:1789297324.350931:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+12:2354:x1876213933072512:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297324.350945:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297324.350980:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 12 pid: 6687 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.350996:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 12 pid: 6687 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.351034:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297324.351039:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297324.351049:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.351070:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.351118:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 12 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.351135:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876213957201280:192.168.202.43@tcp:105: 00000100:00100000:1.0:1789297324.351225:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0180 going to sleep for 11 seconds 00010000:00010000:2.0:1789297324.352136:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f68769c2/0x8ad177e823a0bca8 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab9 expref: 12 pid: 6687 timeout: 436 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.352157:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b2021ce00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957201152:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297324.352189:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 11 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.352200:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257200, rc 0) 00000100:00100000:2.0:1789297324.352259:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+11:10574:x1876213933072384:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 5855us (6045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.352268:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:1.0:1789297324.356120:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259ed80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5828:1876213957201280:192.168.202.43@tcp:105: 00010000:00010000:1.0:1789297324.356152:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297324.356229:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+10:2354:x1876213933072512:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 5299us (5569us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.356241:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:0.0:1789297324.361293:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297324.361394:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933072640 00000100:00100000:3.0:1789297324.361404:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933072640 00002000:00100000:3.0:1789297324.361458:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff982b277df800 x1876213933072640/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:185/0 lens 504/0 e 0 to 0 dl 1789297335 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297324.361470:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b277df800 with x1876213933072640 ext(0->12) 00002000:00010000:3.0:1789297324.361476:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b277df800 00000100:00100000:3.0:1789297324.361510:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:3.0:1789297324.361520:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+10:2353:x1876213933072640:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789297324.363264:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277df800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+12:2353:x1876213933072640:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 1738us (1973us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789297324.363276:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00002000:00100000:3.0:1789297324.363288:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff982b277df800 x1876213933072640/t4294967308(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:185/0 lens 504/448 e 0 to 0 dl 1789297335 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297324.363297:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b277df800 with x1876213933072640 ext(0->12) 00002000:00010000:3.0:1789297324.363302:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b277df800 00000100:00100000:0.0:1789297324.366496:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.366777:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933072768 00000100:00100000:1.0:1789297324.366799:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933072768 00000100:00100000:1.0:1789297324.366906:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:1.0:1789297324.366919:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+61:10574:x1876213933072768:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1789297324.424663:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967397 is committed 00000004:00080000:1.0:1789297324.424867:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:1.0:1789297324.424889:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b10f2aa80 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:1.0:1789297324.424895:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b11c3b100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b10f2a0c0 00000020:00080000:1.0:1789297324.424898:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b11c3bf00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982b39c9ec00 00000001:00080000:1.0:1789297324.424912:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000020:00080000:1.0:1789297324.424939:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b385c0240 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:1.0:1789297324.424942:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b1fc4bb00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b385c0e40 00000020:00080000:1.0:1789297324.424945:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b1fc4b900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982b03d0ac00 00000001:00080000:1.0:1789297324.424968:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000004:00080000:1.0:1789297324.425013:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:1.0:1789297324.425044:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:1.0:1789297324.425233:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1789297324.425353:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957201408:0@lo:6:osp-syn-1-0.0 00000100:00100000:1.0:1789297324.425434:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297324.425514:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957201408 00000100:00100000:1.0:1789297324.425523:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957201408 00000100:00100000:1.0:1789297324.425599:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1789297324.425609:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876213957201408:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:1.0:1789297324.425645:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00000100:00100000:2.0:1789297324.425835:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b2021ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957201536:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789297324.425867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297324.425900:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957201536 00000100:00100000:2.0:1789297324.425904:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957201536 00000100:00100000:2.0:1789297324.425929:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789297324.425936:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957201536:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789297324.425949:0:6688:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:2.0:1789297324.426016:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6aa682ab, atime: 0x0, ctime: 0x6aa682ab, blocks: 0x1 00010000:00010000:2.0:1789297324.426023:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426042:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=336s v=(0 0) 00010000:00010000:2.0:1789297324.426047:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297324.426054:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426071:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426083:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426090:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426108:0:6688:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789297324.426486:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3305:x1876213957201536:12345-0@lo:6:osp-syn-0-0.0 Request processed in 550us (617us total) trans 4294967304 rc 0/0 00000100:00100000:2.0:1789297324.426491:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00010000:2.0:1789297324.426513:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297324.426518:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426524:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297324.426532:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426539:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426552:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426557:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000187b22aa/0x8ad177e823a0bcbd lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.426572:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297324.426574:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297324.426576:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1789297324.426606:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b2021ce00/2, rc 0, transno 4294967304 00000100:00100000:2.0:1789297324.426612:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b2021ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957201536:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1789297324.426938:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.426963:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 11 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.426971:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1789297324.426975:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297324.426979:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.427011:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 11 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.427039:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 11 pid: 11700 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.427052:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957201664:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297324.427160:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0300 going to sleep for 11 seconds 00000100:00080000:1.0:1789297324.427174:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297324.427243:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+15:10574:x1876213933072768:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 60328us (60758us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.427251:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 124 00000100:00100000:0.0:1789297324.429634:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.429830:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933072896 00000100:00100000:2.0:1789297324.429840:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933072896 00000100:00100000:2.0:1789297324.429891:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:2.0:1789297324.429902:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+12:2353:x1876213933072896:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789297324.435116:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957201664:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297324.435167:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.436405:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297324.436607:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933073024 00000100:00100000:3.0:1789297324.436618:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933073024 00010000:00010000:3.0:1789297324.436653:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 13 pid: 11700 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.436693:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:3.0:1789297324.436727:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+13:2353:x1876213933073024:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297324.436740:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297324.436745:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 13 pid: 11700 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.436775:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 13 pid: 11700 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.436800:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0ba78 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da1f expref: 13 pid: 11700 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.436816:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789297324.436821:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1789297324.436827:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.436837:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.436860:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297324.436912:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+12:2353:x1876213933073024:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 209us (512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297324.436920:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00010000:00010000:1.0:1789297324.437646:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.437657:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.437665:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.437672:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.437738:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297324.438035:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297324.438044:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.438052:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297324.438064:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.438073:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.438089:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.438096:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.438116:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297324.438118:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297324.438120:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297324.438570:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1876213957201408:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12958us (13132us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1789297324.438581:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000004:00080000:2.0:1789297324.441038:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b0259ed80/2, rc 0, transno 4294967309 00000100:00100000:2.0:1789297324.441060:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957201408:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1789297324.537454:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1789297324.537475:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000001:00080000:3.0:1789297324.537482:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967307 is committed 00000001:00080000:3.0:1789297324.537493:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000100:00100000:2.0:1789297324.537659:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933072896:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 107753us (108027us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.537671:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00010000:00010000:0.0:1789297324.544570:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297324.545876:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.545984:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933073280 00000100:00100000:0.0:1789297324.545999:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933073280 00000100:00100000:0.0:1789297324.546079:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 125 00000100:00100000:0.0:1789297324.546092:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+15:10574:x1876213933073280:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789297324.546186:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297324.546216:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bca1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dab2 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.546232:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:0.0:1789297324.546235:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297324.546264:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.546275:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.546283:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789297324.546519:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000753b4f80 reply state 0000000053cfec55 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297324.546527:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789297324.546639:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+16:10574:x1876213933073280:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 549us (776us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1789297324.546646:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 125 00010000:00010000:2.0:1789297324.551195:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.551214:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.551222:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.551246:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297324.551251:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.551260:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.551279:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:2.0:1789297324.551282:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297324.551287:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.551293:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bcc4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.553086:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.553215:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933073408 00000100:00100000:1.0:1789297324.553226:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933073408 00000100:00100000:1.0:1789297324.553326:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:1.0:1789297324.553338:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933073408:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789297324.553589:0:11700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:1.0:1789297324.553593:0:11700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789297324 00002000:00010000:1.0:1789297324.553595:0:11700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789297323 00002000:00010000:1.0:1789297324.553597:0:11700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789297324 -> 1789297324 00002000:00010000:1.0:1789297324.553599:0:11700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789297324.553672:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933073408:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 335us (596us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1789297324.553687:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:3.0:1789297324.556304:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.556397:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933073664 00000100:00100000:2.0:1789297324.556408:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933073664 00000100:00100000:2.0:1789297324.556491:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:2.0:1789297324.556503:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+15:10574:x1876213933073664:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1789297324.556590:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.556608:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.556619:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.556688:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.556726:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 15 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.556743:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957201792:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297324.556832:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af900 going to sleep for 11 seconds 00000100:00100000:3.0:1789297324.559776:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957201792:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297324.559817:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.560019:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297324.560470:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933073792 00000100:00100000:3.0:1789297324.560477:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933073792 00010000:00010000:3.0:1789297324.560514:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 16 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.560567:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:3.0:1789297324.560578:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+16:2353:x1876213933073792:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297324.560592:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297324.560599:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 16 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.560612:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 16 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.560633:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bc85 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daa4 expref: 16 pid: 7920 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.560650:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:3.0:1789297324.560654:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.560663:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.560671:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.561849:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297324.561968:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+15:2353:x1876213933073792:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 1377us (1934us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297324.561979:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00010000:00010000:2.0:1789297324.565138:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.565157:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.565276:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.565285:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.565292:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.565297:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297324.565302:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.565310:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.565328:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:3.0:1789297324.565331:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:3.0:1789297324.565336:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.565342:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bccb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.565482:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:10574:x1876213933073664:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 8977us (9183us total) trans 0 rc -22/-22 00000100:00100000:3.0:1789297324.565492:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 126 00000100:00100000:2.0:1789297324.572415:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.572550:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933073920 00000100:00100000:1.0:1789297324.572569:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933073920 00000100:00100000:1.0:1789297324.572666:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:1.0:1789297324.572678:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933073920:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:1.0:1789297324.572769:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.572792:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.572821:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297324.572826:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297324.572832:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.572870:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 7 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.572885:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 7 pid: 6689 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.572901:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957201920:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297324.573012:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297324.575894:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.576057:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933074048 00000100:00100000:0.0:1789297324.576067:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933074048 00010000:00010000:0.0:1789297324.576109:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 8 pid: 6689 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297324.576159:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:0.0:1789297324.576170:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933074048:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297324.576194:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297324.576219:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 8 pid: 6689 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.576233:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 8 pid: 6689 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.576261:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789297324.576265:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789297324.576271:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.576281:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.576302:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297324.576360:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933074048:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 190us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297324.576368:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00010000:00010000:1.0:1789297324.577506:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0bcaf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac0 expref: 7 pid: 6689 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.577526:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957201920:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297324.577551:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577574:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577582:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577620:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577628:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577636:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577643:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297324.577648:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577657:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577671:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.577822:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0bcd2 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.578536:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:2353:x1876213933073920:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 5855us (6126us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.578557:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:3.0:1789297324.583048:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.583177:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933074304 00000100:00100000:0.0:1789297324.583186:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933074304 00000100:00100000:0.0:1789297324.583240:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 127 00000100:00100000:0.0:1789297324.583248:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:10574:x1876213933074304:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789297324.583315:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.583331:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.583358:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.583563:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.583575:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.583582:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.583615:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 15 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297324.583629:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 15 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297324.583640:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957202048:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297324.583752:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b000 going to sleep for 11 seconds 00000100:00100000:0.0:1789297324.593023:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.593162:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957202048:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297324.593193:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.593263:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933074432 00000100:00100000:2.0:1789297324.593270:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933074432 00010000:00010000:2.0:1789297324.593305:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 16 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.593341:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:2.0:1789297324.593351:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+16:2354:x1876213933074432:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297324.593367:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297324.593383:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 16 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.593392:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 16 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.593412:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bc93 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daab expref: 16 pid: 5843 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.593425:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:2.0:1789297324.593429:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.593436:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.593440:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.593464:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297324.593515:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+15:2354:x1876213933074432:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 166us (500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.593519:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00010000:00010000:1.0:1789297324.593571:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.593577:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789297324.593816:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1789297324.593937:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1789297324.594002:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1789297324.594073:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876213957202176:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789297324.594114:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297324.594133:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c00c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297324.594501:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957202176 00000100:00100000:2.0:1789297324.594506:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957202176 00000100:00100000:2.0:1789297324.594535:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789297324.594541:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876213957202176:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789297324.594619:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876213957202176:12345-0@lo:1000:mdt00_002.0 Request processed in 77us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297324.594636:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297324.595893:0:5844:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:1.0:1789297324.595903:0:5844:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:1.0:1789297324.595922:0:5844:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982b0259ed80 x1876213957201408/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789297340 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297324.595932:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876213957202176:0@lo:1000:mdt00_002.0 00000001:00080000:1.0:1789297324.596488:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:1.0:1789297324.596638:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876213957202304:0@lo:1000:mdt00_002.0 00000100:00100000:1.0:1789297324.596825:0:5844:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297324.596926:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789297324.597393:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957202304 00000100:00100000:2.0:1789297324.597399:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957202304 00000100:00100000:2.0:1789297324.597484:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789297324.597493:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5844:x1876213957202304:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789297324.597891:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40950000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5844:x1876213957202304:12345-0@lo:1000:mdt00_002.0 Request processed in 399us (1065us total) trans 4294967311 rc 0/0 00000100:00100000:2.0:1789297324.597897:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789297324.597979:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:5844:1876213957202304:0@lo:1000:mdt00_002.0 00010000:00010000:1.0:1789297324.598015:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598023:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598038:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598042:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.598045:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598050:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598065:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b15d3a100) 00010000:00010000:1.0:1789297324.598068:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789297324.598071:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598075:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0bce0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598100:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598103:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598107:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598110:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.598112:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598123:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598128:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297324.598129:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789297324.598134:0:5844:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598142:0:5844:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598148:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.598183:0:5844:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 18 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.598192:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c86a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957202432:192.168.202.43@tcp:105: 00000100:00100000:1.0:1789297324.598259:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297324.601009:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c86a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957202432:192.168.202.43@tcp:105: 00010000:00010000:1.0:1789297324.601046:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601058:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0bc23 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601096:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601126:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601139:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601150:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601169:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601175:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601181:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.601185:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601194:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601206:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297324.601209:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297324.601212:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601218:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bce7 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601228:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601240:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601247:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601253:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.601256:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601262:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601271:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297324.601273:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789297324.601277:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.601282:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bcd9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297324.601509:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+18:10574:x1876213933074304:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 18260us (18470us total) trans 4294967406 rc 0/0 00000100:00100000:1.0:1789297324.601519:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 127 00000020:00080000:1.0:1789297324.601526:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:3.0:1789297324.602321:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789297324.602329:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789297324.602848:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:3.0:1789297324.602857:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789297324.604658:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297324.605663:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933074560 00000100:00100000:0.0:1789297324.605686:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933074560 00000100:00100000:1.0:1789297324.605993:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:1.0:1789297324.606008:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:10572:x1876213933074560:12345-192.168.202.43@tcp:49:lfs.0 00000100:00100000:1.0:1789297324.606176:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:10572:x1876213933074560:12345-192.168.202.43@tcp:49:lfs.0 Request processed in 172us (1524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.606203:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:1.0:1789297324.608248:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.608336:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933074816 00000100:00100000:2.0:1789297324.608347:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933074816 00000100:00100000:2.0:1789297324.608413:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:2.0:1789297324.608425:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13012850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:10574:x1876213933074816:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789297324.609189:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789297324.609299:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:2.0:1789297324.609349:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.609365:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.609379:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.609388:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.609395:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.609412:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.609429:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1789297324.609534:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13012850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+20:10574:x1876213933074816:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 1108us (1292us total) trans 4294967408 rc 0/0 00000100:00100000:2.0:1789297324.609543:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000020:00080000:2.0:1789297324.609548:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1789297324.610273:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297324.610283:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.610291:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257e00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297324.610296:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.610305:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.610322:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff982b2ac85e00) 00010000:00010000:3.0:1789297324.610325:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789297324.610330:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.610336:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcee lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.610354:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297324.610355:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297324.610357:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297324.612299:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297324.612375:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933075072 00000100:00100000:1.0:1789297324.612384:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933075072 00000100:00100000:1.0:1789297324.612445:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 128 00000100:00100000:1.0:1789297324.612457:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+20:10572:x1876213933075072:12345-192.168.202.43@tcp:58:lfs.0 00000040:00080000:1.0:1789297324.612762:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:1.0:1789297324.612839:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+20:10572:x1876213933075072:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 383us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.612846:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 128 00000100:00100000:1.0:1789297324.644986:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297324.645096:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933075200 00000100:00100000:2.0:1789297324.645107:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933075200 00000100:00100000:2.0:1789297324.645189:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:2.0:1789297324.645202:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+20:10576:x1876213933075200:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297324.645231:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297324.645254:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcf5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dac7 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645325:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645340:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645351:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645365:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645372:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645398:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645638:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645650:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645659:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.645694:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297324.646086:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 21 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.646103:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957202560:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297324.646426:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af180 going to sleep for 11 seconds 00000100:00100000:0.0:1789297324.648916:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297324.649083:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259ce00 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957202560:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297324.649133:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297324.649279:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933075456 00000100:00100000:2.0:1789297324.649287:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933075456 00000100:00100000:2.0:1789297324.649341:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:2.0:1789297324.649350:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+22:5594:x1876213933075456:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1789297324.649663:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+23:5594:x1876213933075456:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 312us (755us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1789297324.649671:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:0.0:1789297324.654987:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297324.655084:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933075584 00000100:00100000:3.0:1789297324.655095:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933075584 00010000:00010000:3.0:1789297324.655139:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 23 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297324.655694:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:3.0:1789297324.655743:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+23:2354:x1876213933075584:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297324.655760:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297324.655768:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 23 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.655784:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 23 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.655806:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bc15 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da88 expref: 23 pid: 5844 timeout: 436 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.655823:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:3.0:1789297324.655828:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.655839:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.655847:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297324.655894:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297324.655944:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+22:2354:x1876213933075584:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 240us (966us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297324.655963:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00010000:00010000:1.0:1789297324.656402:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656412:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297324.656455:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1789297324.656460:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297324.656480:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656494:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656503:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656510:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656526:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656532:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.656536:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656544:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656566:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:1.0:1789297324.656569:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297324.656573:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656579:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bcfc lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656591:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656597:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656604:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656609:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297324.656612:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656629:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656638:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff982b2ac85000) 00010000:00010000:1.0:1789297324.656640:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297324.656643:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656649:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bd03 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656685:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bcf5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac7 expref: 22 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656700:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac7 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297324.656742:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:1.0:1789297324.656745:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297324.656748:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257800, rc 0) 00000100:00100000:1.0:1789297324.656789:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c86a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:10576:x1876213933075200:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 11590us (11814us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.656796:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 129 00000100:00100000:2.0:1789297324.989068:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957202944:0@lo:400:kworker.0 00000100:00100000:2.0:1789297324.989151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297324.989208:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297324.989215:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b277de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957203072:0@lo:400:kworker.0 00000100:00100000:2.0:1789297324.989238:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297324.989305:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957202816:0@lo:400:kworker.0 00000100:00100000:1.0:1789297324.989337:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297324.989366:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297324.989372:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957202688:0@lo:400:kworker.0 00000100:00100000:1.0:1789297324.989410:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297324.989445:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957202944 00000100:00100000:1.0:1789297324.989453:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957202944 00000100:00100000:1.0:1789297324.989500:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957203072 00000100:00100000:1.0:1789297324.989503:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957203072 00000100:00100000:1.0:1789297324.989523:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957202816 00000100:00100000:1.0:1789297324.989526:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957202816 00000100:00100000:1.0:1789297324.989542:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789297324.989549:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957202944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297324.989599:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957202944:12345-0@lo:400:kworker.0 Request processed in 50us (448us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.989606:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:1.0:1789297324.989622:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789297324.989628:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957203072:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297324.989654:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120af100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957203072:12345-0@lo:400:kworker.0 Request processed in 27us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.989660:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1789297324.989671:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789297324.989677:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957202816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297324.989967:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957202816:12345-0@lo:400:kworker.0 Request processed in 288us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.989973:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1789297324.989994:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957202688 00000100:00100000:1.0:1789297324.989998:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957202688 00000100:00100000:1.0:1789297324.990022:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1789297324.990027:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957202688:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297324.990057:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3303:x1876213957202688:12345-0@lo:400:kworker.0 Request processed in 30us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297324.990069:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:1.0:1789297324.990095:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297324.990128:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957202688:0@lo:400:kworker.0 00000100:00100000:1.0:1789297324.990143:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957202816:0@lo:400:kworker.0 00000100:00100000:2.0:1789297324.990399:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b277de300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957203072:0@lo:400:kworker.0 00000100:00100000:2.0:1789297324.990411:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957202944:0@lo:400:kworker.0 00000004:00080000:0.0:1789297325.501810:0:7926:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 337376103176ns, next at 338376100678ns, rc = 0 00000100:00100000:0.0:1789297325.501842:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957203200:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297325.501910:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297325.502008:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957203200 00000100:00100000:0.0:1789297325.502016:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957203200 00000100:00100000:0.0:1789297325.502065:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789297325.502074:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957203200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297325.502097:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3856662528 00000100:00100000:0.0:1789297325.502143:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957203200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (233us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297325.502151:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1789297325.502200:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957203200:0@lo:13:osp-pre-1-0.0 00000040:00080000:2.0:1789297325.516965:0:12117:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297325.516976:0:12117:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297325.518195:0:12117:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789297325.518206:0:12117:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:2.0:1789297325.575447:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1789297325.628914:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1789297325.628927:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1789297325.628984:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1789297325.628992:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789297325.629146:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957203328:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789297325.629261:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c53a80 going to sleep for 11 seconds 00000100:00100000:2.0:1789297325.642773:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fce680 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957203328:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1789297325.643752:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297325.643877:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933075712 00000100:00100000:2.0:1789297325.643886:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933075712 00000100:00100000:2.0:1789297325.643988:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00100000:2.0:1789297325.644009:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+21:10589:x1876213933075712:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789297325.644050:0:7920:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789297325.644187:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+21:10589:x1876213933075712:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 190us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297325.644195:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 130 00000100:00080000:3.0:1789297325.644861:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297325.648251:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297325.648381:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933075968 00000100:00100000:0.0:1789297325.648392:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933075968 00000100:00100000:0.0:1789297325.648456:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:0.0:1789297325.648465:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+21:10589:x1876213933075968:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297325.648485:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297325.648506:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bd11 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dace expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.648616:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bd18 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.648632:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bd18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.648645:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bd18 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297325.648657:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1789297325.648835:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0bd11 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dace expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.648870:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bd18 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dace expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.648879:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297325.648882:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297325.648885:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba200, rc 0) 00000100:00100000:0.0:1789297325.648936:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+23:10589:x1876213933075968:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 472us (694us total) trans 4294967410 rc 0/0 00000100:00100000:0.0:1789297325.648953:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 131 00000100:00100000:3.0:1789297325.652042:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297325.652151:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933076096 00000100:00100000:0.0:1789297325.652170:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933076096 00000100:00100000:0.0:1789297325.652252:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789297325.652264:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+23:2355:x1876213933076096:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297325.652281:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297325.652307:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0bd18 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dace expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.652327:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297325.652332:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297325.652384:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+22:2355:x1876213933076096:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 123us (355us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297325.652391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:3.0:1789297325.656726:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297325.656818:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933076352 00000100:00100000:0.0:1789297325.656829:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933076352 00000100:00100000:0.0:1789297325.656890:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 132 00000100:00100000:0.0:1789297325.656910:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+22:10589:x1876213933076352:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789297325.657008:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657031:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657044:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657257:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657264:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657270:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657276:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297325.657280:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657288:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657300:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297325.657303:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789297325.657307:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297325.657313:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0bd26 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297325.657474:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+23:10589:x1876213933076352:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 565us (780us total) trans 4294967411 rc 0/0 00000100:00100000:0.0:1789297325.657483:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 132 00000040:00080000:0.0:1789297325.657597:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789297325.657603:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789297325.658139:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:0.0:1789297325.658147:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789297325.661102:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297325.661208:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933076608 00000100:00100000:0.0:1789297325.661610:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933076608 00000100:00100000:0.0:1789297325.661679:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:0.0:1789297325.661689:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+23:10589:x1876213933076608:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789297325.661964:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+24:10589:x1876213933076608:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 276us (876us total) trans 4294967412 rc 0/0 00000100:00100000:0.0:1789297325.661973:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:2.0:1789297326.021406:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957203456:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297326.021486:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297326.026133:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957203456 00000100:00100000:1.0:1789297326.026152:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957203456 00000100:00100000:1.0:1789297326.026261:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789297326.026271:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957203456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297326.026315:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297326.026411:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957203456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 141us (4924us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297326.026420:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789297326.026480:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957203456:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789297326.026560:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1789297326.588874:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297327.504911:0:12169:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789297327.504921:0:12169:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789297327.505003:0:12169:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1789297327.505009:0:12169:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789297327.602229:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297327.602279:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297327.602319:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297327.602341:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297327.602401:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297327.602435:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933077248 00000100:00100000:3.0:1789297327.602445:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933077248 00000100:00100000:3.0:1789297327.602504:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933076864 00000100:00100000:3.0:1789297327.602508:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933076864 00000100:00100000:3.0:1789297327.602552:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 139 00000100:00100000:3.0:1789297327.602564:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933077248:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297327.602634:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933076736 00000100:00100000:0.0:1789297327.602639:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933076736 00000100:00100000:3.0:1789297327.602657:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933077248:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 95us (336us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297327.602666:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 139 00000100:00100000:0.0:1789297327.602681:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 288 00000100:00100000:3.0:1789297327.602682:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:3.0:1789297327.602688:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+24:2355:x1876213933076864:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297327.602688:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933076736:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297327.602738:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+24:2355:x1876213933076864:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 50us (396us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297327.602745:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:0.0:1789297327.602746:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933076736:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 60us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297327.602752:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 288 00000100:00100000:3.0:1789297327.602763:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933076992 00000100:00100000:3.0:1789297327.602767:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933076992 00000100:00100000:3.0:1789297327.602793:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933077120 00000100:00100000:3.0:1789297327.602796:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933077120 00000100:00100000:3.0:1789297327.602836:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:3.0:1789297327.602843:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933076992:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297327.602870:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933076992:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (591us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297327.602876:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:3.0:1789297327.602888:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:3.0:1789297327.602894:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933077120:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297327.602916:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2355:x1876213933077120:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (516us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297327.602922:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00080000:3.0:1789297327.602948:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297327.602953:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297327.602955:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789297327.614382:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297327.742512:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297327.742568:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933077504 00000100:00100000:3.0:1789297327.742578:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933077504 00000100:00100000:3.0:1789297327.742640:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:3.0:1789297327.742649:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+24:10610:x1876213933077504:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297327.742673:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297327.742693:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd2d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dad5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297327.742817:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bd34 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297327.742831:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bd34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297327.742843:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bd34 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297327.742855:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:3.0:1789297327.743002:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd2d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dad5 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297327.743020:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bd34 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dad5 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297327.743030:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:3.0:1789297327.743033:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:3.0:1789297327.743036:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fe00, rc 0) 00000100:00100000:3.0:1789297327.743095:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38699500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+26:10610:x1876213933077504:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 446us (590us total) trans 4294967413 rc 0/0 00000100:00100000:3.0:1789297327.743112:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 133 00000100:00100000:1.0:1789297327.756397:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297327.757012:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933077632 00000100:00100000:0.0:1789297327.757024:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933077632 00000100:00100000:0.0:1789297327.757105:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:0.0:1789297327.757205:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+26:10610:x1876213933077632:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:0.0:1789297327.757281:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757300:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757312:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757339:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757347:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757353:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757360:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297327.757365:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757373:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757387:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:0.0:1789297327.757390:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297327.757395:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297327.757401:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb200/0x8ad177e823a0bd42 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297327.757495:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+26:10610:x1876213933077632:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 293us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297327.761203:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 134 00000100:00100000:3.0:1789297327.888367:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297327.888642:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933077760 00000100:00100000:1.0:1789297327.888653:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933077760 00000100:00100000:1.0:1789297327.888832:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:1.0:1789297327.888844:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933077760:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:1.0:1789297327.888865:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297327.888886:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0bd49 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dadc expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789297327.888944:0:11700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa682ac, atime: 0x6aa682ab, ctime: 0x6aa682ac, blocks: 0xb 00010000:00010000:1.0:1789297327.888971:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=339s v=(0 0) 00010000:00010000:1.0:1789297327.888976:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297327.888987:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0bd49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dadc expref: 7 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297327.889007:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0bd49 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dadc expref: 7 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297327.889018:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3c00, rc 0) 00000100:00100000:1.0:1789297327.889081:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933077760:12345-192.168.202.43@tcp:101:cat.0 Request processed in 239us (723us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297327.889088:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:0.0:1789297327.893903:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297327.894042:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933077888 00000100:00100000:3.0:1789297327.894054:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933077888 00002000:00100000:3.0:1789297327.894264:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff982b385a0000 x1876213933077888/t0(0) o3->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:188/0 lens 488/0 e 0 to 0 dl 1789297338 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297327.894277:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b385a0000 with x1876213933077888 ext(0->4095) 00002000:00010000:3.0:1789297327.894284:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b385a0000 00000100:00100000:3.0:1789297327.894322:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:3.0:1789297327.894334:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933077888:12345-192.168.202.43@tcp:3:cat.0 00000100:00100000:3.0:1789297327.894813:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933077888:12345-192.168.202.43@tcp:3:cat.0 Request processed in 479us (919us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1789297327.894823:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00002000:00100000:3.0:1789297327.894830:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff982b385a0000 x1876213933077888/t0(0) o3->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:188/0 lens 488/4536 e 0 to 0 dl 1789297338 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297327.894839:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b385a0000 with x1876213933077888 ext(0->4095) 00002000:00010000:3.0:1789297327.894842:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b385a0000 00010000:00010000:0.0:1789297328.639698:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789297328.685698:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000001:00080000:1.0:1789297328.685736:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00010000:00010000:0.0:1789297329.660885:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789297329.664250:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967412 is committed 00000004:00080000:1.0:1789297329.664273:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000020:00080000:1.0:1789297329.664309:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b385c00c0 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:1.0:1789297329.664315:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b1fc4b800 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b385c0840 00000020:00080000:1.0:1789297329.664318:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b1fc4b100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982b39888c00 00000020:00080000:1.0:1789297329.664340:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000001:00080000:1.0:1789297329.664356:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1789297329.664393:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 3 00000020:00080000:2.0:1789297329.664581:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 3 00000100:00100000:2.0:1789297329.664840:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957203584:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789297329.664964:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297329.665100:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957203584 00000100:00100000:0.0:1789297329.665110:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957203584 00000100:00100000:0.0:1789297329.665183:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789297329.665194:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:3304:x1876213957203584:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1789297329.665398:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1789297329.665402:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1789297324 -> 1789297324 00002000:00010000:0.0:1789297329.665405:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1789297323 -> 1789297323 00002000:00010000:0.0:1789297329.665406:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1789297324 -> 1789297324 00002000:00010000:0.0:1789297329.665409:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1789297329.665450:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120aca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+8:3304:x1876213957203584:12345-0@lo:2:osp-syn-1-0.0 Request processed in 258us (486us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1789297329.665457:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00080000:1.0:1789297329.665731:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:2.0:1789297329.665771:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b385a3b80/2, rc 0, transno 4294967312 00000100:00100000:2.0:1789297329.665778:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957203584:0@lo:2:osp-syn-1-0.0 00000001:00080000:3.0:1789297329.675228:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000001:00080000:3.0:1789297329.675246:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967309 is committed 00000001:00080000:3.0:1789297329.675252:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000100:00100000:2.0:1789297330.110915:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957203712:0@lo:400:kworker.0 00000100:00100000:2.0:1789297330.111000:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297330.111350:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789297330.111358:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957204096:0@lo:400:kworker.0 00000100:00100000:2.0:1789297330.111392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297330.111427:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957203712 00000100:00100000:2.0:1789297330.111434:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957203712 00000100:00100000:2.0:1789297330.111482:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789297330.111490:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957203712:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297330.111543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12155850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957203712:12345-0@lo:400:kworker.0 Request processed in 54us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297330.111550:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:2.0:1789297330.111583:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204096 00000100:00100000:2.0:1789297330.111587:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204096 00000100:00100000:2.0:1789297330.111635:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1789297330.111643:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957204096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297330.111687:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957204096:12345-0@lo:400:kworker.0 Request processed in 34us (282us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297330.111693:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1789297330.111836:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:3.0:1789297330.111843:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967304 00000004:00080000:3.0:1789297330.111860:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b2021ce00, transno 4294967304 00000100:00100000:3.0:1789297330.111873:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957204096:0@lo:400:kworker.0 00000100:00100000:3.0:1789297330.111892:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957203712:0@lo:400:kworker.0 00000100:00080000:2.0:1789297330.111981:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297330.112829:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957204224:0@lo:400:kworker.0 00000100:00100000:0.0:1789297330.112865:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957203840:0@lo:400:kworker.0 00000100:00100000:3.0:1789297330.112872:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297330.112896:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957203968:0@lo:400:kworker.0 00000100:00100000:0.0:1789297330.112928:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297330.112951:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204224 00000100:00100000:3.0:1789297330.112956:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204224 00000100:00100000:0.0:1789297330.112966:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297330.112989:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957203968 00000100:00100000:0.0:1789297330.112990:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957203840 00000100:00100000:3.0:1789297330.112992:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957203968 00000100:00100000:0.0:1789297330.112992:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957203840 00000100:00100000:3.0:1789297330.113007:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1789297330.113058:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957204224:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297330.113101:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957204224:12345-0@lo:400:kworker.0 Request processed in 89us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297330.113202:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789297330.113211:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957203968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297330.113469:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957203968:12345-0@lo:400:kworker.0 Request processed in 258us (538us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297330.113476:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:0.0:1789297330.113493:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789297330.113500:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957203840:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297330.113531:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957203840:12345-0@lo:400:kworker.0 Request processed in 31us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297330.113537:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:0.0:1789297330.113573:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957203968:0@lo:400:kworker.0 00000100:00100000:0.0:1789297330.113599:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957203840:0@lo:400:kworker.0 00000100:00080000:0.0:1789297330.114789:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297330.117387:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957204224:0@lo:400:kworker.0 00000100:00100000:3.0:1789297330.119138:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1789297330.622136:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957204352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297330.622215:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297330.622312:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204352 00000100:00100000:3.0:1789297330.622320:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204352 00000100:00100000:3.0:1789297330.622377:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1789297330.622388:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957204352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297330.622426:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297330.625736:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957204352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3341us (3512us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297330.625753:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1789297330.626683:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1789297330.626693:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b0259ed80, transno 4294967309 00000004:00080000:1.0:1789297330.626728:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1789297330.626756:0:3302:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982b385a3b80 x1876213957203584/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1789297345 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297330.626777:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957204352:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789297330.685111:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297331.134009:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957204480:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297331.134091:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297331.134246:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204480 00000100:00100000:3.0:1789297331.134255:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204480 00000100:00100000:3.0:1789297331.134314:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789297331.134326:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957204480:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297331.134362:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297331.134410:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cc700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957204480:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (318us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297331.134430:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789297331.134475:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957204480:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789297331.709046:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789297331.776171:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297331.776181:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297331.776238:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:2.0:1789297331.776247:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789297332.147596:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297332.152309:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933078016 00000100:00100000:1.0:1789297332.152325:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933078016 00000100:00100000:1.0:1789297332.152466:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 135 00000100:00100000:1.0:1789297332.152479:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:10253:x1876213933078016:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789297332.152606:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:10253:x1876213933078016:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 Request processed in 130us (5079us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297332.152613:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 135 00000100:00080000:0.0:1789297332.155862:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297332.157345:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297332.157462:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933078272 00000100:00100000:3.0:1789297332.157473:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933078272 00000100:00100000:3.0:1789297332.157526:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:3.0:1789297332.157543:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+13:10253:x1876213933078272:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789297332.159613:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:10253:x1876213933078272:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 2067us (2265us total) trans 4294967414 rc 0/0 00000100:00100000:3.0:1789297332.159626:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:3.0:1789297332.387743:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297332.388185:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933078400 00000100:00100000:2.0:1789297332.388197:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933078400 00000100:00100000:2.0:1789297332.388336:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00100000:2.0:1789297332.388346:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:11064:x1876213933078400:12345-192.168.202.43@tcp:101:lsof.0 00010000:00010000:2.0:1789297332.388368:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297332.388389:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0bd50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dae3 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297332.388454:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297332.388467:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297332.388593:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297332.388915:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789297332.388920:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297332.388961:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297332.388989:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0bd50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297332.389008:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297332.389033:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297332.389037:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297332.389041:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257200, rc 0) 00000100:00100000:2.0:1789297332.389150:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38699c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:11064:x1876213933078400:12345-192.168.202.43@tcp:101:lsof.0 Request processed in 805us (1450us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297332.389158:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 136 00000100:00080000:0.0:1789297332.389386:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297332.718140:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297332.718332:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297332.718388:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297332.718469:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933078784 00000100:00100000:3.0:1789297332.718491:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933078784 00000100:00100000:3.0:1789297332.718560:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933078656 00000100:00100000:3.0:1789297332.718564:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933078656 00000100:00100000:3.0:1789297332.718590:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:3.0:1789297332.718612:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933078784:12345-192.168.202.43@tcp:400:kworker.0 00000100:00080000:1.0:1789297332.718777:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789297332.718782:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297332.718807:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:1.0:1789297332.718816:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933078656:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297332.718864:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933078656:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 51us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297332.718872:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:3.0:1789297332.718986:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933078784:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 387us (653us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297332.718993:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:0.0:1789297332.722977:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933078528 00000100:00100000:0.0:1789297332.722996:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933078528 00000100:00100000:0.0:1789297332.723075:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 290 00000100:00100000:0.0:1789297332.723084:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933078528:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297332.723183:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933078528:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 100us (5054us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297332.723206:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 290 00010000:00010000:0.0:1789297332.732912:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297333.757514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:1.0:1789297334.763087:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000001:00080000:1.0:1789297334.763121:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:3.0:1789297334.763139:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:3.0:1789297334.763151:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:3.0:1789297334.778223:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:0.0:1789297334.780946:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297335.234746:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957204864:0@lo:400:kworker.0 00000100:00100000:1.0:1789297335.234843:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297335.234915:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297335.234922:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957204992:0@lo:400:kworker.0 00000100:00100000:1.0:1789297335.234952:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297335.234998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204864 00000100:00100000:1.0:1789297335.235005:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204864 00000100:00100000:1.0:1789297335.235062:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789297335.235072:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957204864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297335.235124:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957204864:12345-0@lo:400:kworker.0 Request processed in 54us (281us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297335.235132:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1789297335.235155:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204992 00000100:00100000:1.0:1789297335.235158:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204992 00000100:00100000:1.0:1789297335.235185:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1789297335.235193:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957204992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297335.235239:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957204992:12345-0@lo:400:kworker.0 Request processed in 47us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297335.235246:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1789297335.235261:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789297335.235267:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297335.235305:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957204992:0@lo:400:kworker.0 00000100:00100000:1.0:1789297335.235318:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957204864:0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.235930:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957204608:0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.235977:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297335.236017:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957205120:0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.236042:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297335.236061:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1789297335.236068:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957204736:0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.236089:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297335.236107:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957205248:0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.236146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297335.236175:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957205120 00000100:00100000:2.0:1789297335.236180:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957205120 00000100:00100000:2.0:1789297335.236211:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204736 00000100:00100000:2.0:1789297335.236214:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204736 00000100:00100000:2.0:1789297335.236230:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789297335.236238:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957205120:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.236278:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957205120:12345-0@lo:400:kworker.0 Request processed in 40us (234us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297335.236284:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1789297335.236306:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789297335.236311:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957204736:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.236337:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277de300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957204736:12345-0@lo:400:kworker.0 Request processed in 26us (248us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297335.236343:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1789297335.236371:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957204736:0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.236381:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957205120:0@lo:400:kworker.0 00000100:00100000:3.0:1789297335.236479:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957205248 00000100:00100000:3.0:1789297335.236484:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957205248 00000100:00100000:3.0:1789297335.236520:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789297335.236527:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957205248:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297335.236573:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957205248:12345-0@lo:400:kworker.0 Request processed in 47us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297335.236579:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:3.0:1789297335.236602:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:3.0:1789297335.236607:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b385a3b80, transno 4294967312 00000100:00100000:3.0:1789297335.236618:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059c8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957205248:0@lo:400:kworker.0 00000100:00100000:1.0:1789297335.237355:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957204608 00000100:00100000:1.0:1789297335.237369:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957204608 00000100:00100000:1.0:1789297335.237411:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1789297335.237419:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957204608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297335.237482:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957204608:12345-0@lo:400:kworker.0 Request processed in 63us (1503us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297335.237488:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00080000:1.0:1789297335.237524:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789297335.237528:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297335.238643:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a024bc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957204608:0@lo:400:kworker.0 00000100:00100000:2.0:1789297335.741901:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957205376:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297335.741986:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297335.742114:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957205376 00000100:00100000:1.0:1789297335.742123:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957205376 00000100:00100000:1.0:1789297335.742182:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789297335.742193:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957205376:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297335.742236:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297335.742284:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957205376:12345-0@lo:13:osp-pre-1-0.0 Request processed in 93us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297335.742291:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789297335.742554:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059c9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957205376:0@lo:13:osp-pre-1-0.0 00000001:02000400:0.0:1789297335.753770:0:12371:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 07:02:14 (1789297334) 00010000:00010000:0.0:1789297335.805873:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297336.253164:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789297336.253191:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b059cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957205504:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297336.253274:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297336.253543:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957205504 00000100:00100000:1.0:1789297336.253552:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957205504 00000100:00100000:1.0:1789297336.253607:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1789297336.253617:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957205504:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297336.253656:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297336.253748:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957205504:12345-0@lo:13:osp-pre-0-0.0 Request processed in 132us (473us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297336.253755:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:3.0:1789297336.253875:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b059cb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957205504:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1789297336.828912:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297337.623176:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297337.623244:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079040 00000100:00100000:2.0:1789297337.623256:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079040 00000100:00100000:2.0:1789297337.623340:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 137 00000100:00100000:2.0:1789297337.623351:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+13:11330:x1876213933079040:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297337.623381:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297337.623401:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bd5e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57daea expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623467:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623481:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623509:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623525:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623532:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623538:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623849:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bd73 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623859:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bd73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.623865:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bd73 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297337.623876:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:2.0:1789297337.624018:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624026:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624034:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624039:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297337.624049:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624057:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624069:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982b03073300) 00010000:00010000:2.0:1789297337.624072:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297337.624076:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624083:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bd65 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624094:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624100:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624105:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624110:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297337.624113:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624119:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624124:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff982b2ac85100) 00010000:00010000:2.0:1789297337.624127:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297337.624133:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624139:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bd6c lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624488:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bd5e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daea expref: 16 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624502:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bd73 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daea expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297337.624509:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:2.0:1789297337.624512:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297337.624514:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257c00, rc 0) 00000100:00080000:1.0:1789297337.624671:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297337.624822:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+15:11330:x1876213933079040:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1472us (1653us total) trans 4294967415 rc 0/0 00000100:00100000:2.0:1789297337.624839:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 137 00000100:00100000:3.0:1789297337.630157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297337.630390:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079168 00000100:00100000:0.0:1789297337.630402:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079168 00000100:00100000:0.0:1789297337.630513:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:0.0:1789297337.630525:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+15:2354:x1876213933079168:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297337.630540:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297337.630565:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bd73 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daea expref: 15 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297337.630583:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:0.0:1789297337.630588:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297337.630733:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869ad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:2354:x1876213933079168:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 181us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297337.630741:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789297337.636368:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297337.636744:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079296 00000100:00100000:2.0:1789297337.636758:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079296 00000100:00100000:2.0:1789297337.636841:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 138 00000100:00100000:2.0:1789297337.636852:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:11330:x1876213933079296:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1789297337.636960:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:11330:x1876213933079296:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 109us (603us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297337.636967:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 138 00000100:00100000:0.0:1789297337.839877:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297337.839968:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297337.840002:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297337.840036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297337.840068:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079808 00000100:00100000:0.0:1789297337.840079:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079808 00000100:00100000:0.0:1789297337.840168:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:0.0:1789297337.840180:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2354:x1876213933079808:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297337.840263:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2354:x1876213933079808:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 85us (225us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297337.840271:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00080000:0.0:1789297337.840306:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297337.840317:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079680 00000100:00100000:0.0:1789297337.840321:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079680 00000100:00100000:0.0:1789297337.840349:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079552 00000100:00100000:0.0:1789297337.840352:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079552 00000100:00100000:0.0:1789297337.840374:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:0.0:1789297337.840380:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933079680:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297337.840408:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933079680:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 28us (440us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297337.840415:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:0.0:1789297337.840426:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:0.0:1789297337.840433:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933079552:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297337.840535:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933079552:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 102us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297337.840543:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00080000:0.0:1789297337.840571:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789297337.840574:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297337.845946:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079424 00000100:00100000:1.0:1789297337.845976:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079424 00000100:00100000:1.0:1789297337.846083:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 292 00000100:00100000:1.0:1789297337.846094:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933079424:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297337.846180:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12157c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2354:x1876213933079424:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 86us (6315us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297337.846187:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 292 00010000:00010000:0.0:1789297337.855410:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789297337.916985:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297337.916997:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297337.918494:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789297337.918532:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789297338.877296:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297339.481090:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297339.481176:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933079936 00000100:00100000:2.0:1789297339.481188:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933079936 00000100:00100000:2.0:1789297339.481260:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 139 00000100:00100000:2.0:1789297339.481273:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:11372:x1876213933079936:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297339.481296:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297339.481318:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bd81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57daf1 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.481384:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.481399:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.481413:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.481441:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.481449:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.481457:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789297339.481675:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789297339.481988:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.481997:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482015:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482021:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297339.482026:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482034:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482049:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297339.482052:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.482056:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482064:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bd88 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482075:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482081:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482087:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482091:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297339.482094:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482111:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482120:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff982b2ac85800) 00010000:00010000:2.0:1789297339.482123:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.482126:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482132:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bd8f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482178:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bd81 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daf1 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482190:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297339.482192:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.482196:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bd81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daf1 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.482207:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256200, rc 0) 00000100:00100000:2.0:1789297339.482317:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38699f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:11372:x1876213933079936:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1046us (1232us total) trans 0 rc 301/301 00000100:00100000:2.0:1789297339.482325:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 139 00000100:00100000:3.0:1789297339.489980:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297339.490017:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933080192 00000100:00100000:3.0:1789297339.490027:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933080192 00000100:00100000:3.0:1789297339.490080:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:3.0:1789297339.490089:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:11372:x1876213933080192:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:3.0:1789297339.490144:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297339.490273:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0b6ff lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d92a expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.490293:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297339.490298:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297339.490888:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.490905:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.490918:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.490952:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 5 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.490966:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 5 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297339.490980:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38698e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957205632:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297339.491068:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b211cb600 going to sleep for 11 seconds 00000100:00100000:1.0:1789297339.496010:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38698e00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957205632:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297339.496033:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297339.496099:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933080320 00000100:00100000:2.0:1789297339.496108:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933080320 00010000:00010000:2.0:1789297339.496167:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 6 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297339.496192:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297339.496227:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00080000:3.0:1789297339.496259:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297339.496295:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2353:x1876213933080320:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297339.496316:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297339.496324:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 6 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.496337:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 6 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.496363:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bd57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dae3 expref: 6 pid: 5844 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.496389:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297339.496395:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.496404:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.496413:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.496441:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297339.496500:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2353:x1876213933080320:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 208us (469us total) trans 0 rc 0/0 00010000:00010000:3.0:1789297339.496540:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.496547:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.496567:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.496577:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.496585:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297339.497760:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789297339.497783:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.497792:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.497799:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.497806:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297339.497811:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.497836:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.497852:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297339.497856:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297339.497861:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.497867:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0bd96 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297339.497896:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000dc076793 reply state 0000000021a59f57 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297339.497907:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297339.497990:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+15:11372:x1876213933080192:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 7898us (8015us total) trans 4294967416 rc 0/0 00000100:00100000:3.0:1789297339.498000:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 140 00000100:00100000:2.0:1789297339.500293:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00010000:00010000:2.0:1789297339.503724:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.503750:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.503757:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.503763:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297339.503768:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.503775:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.503792:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff982b03073400) 00010000:00010000:2.0:1789297339.503795:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.503799:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.503804:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bd9d lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297339.591584:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297339.591723:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933080448 00000100:00100000:2.0:1789297339.591736:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933080448 00000100:00100000:2.0:1789297339.591821:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:2.0:1789297339.591834:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+14:11380:x1876213933080448:12345-192.168.202.43@tcp:101:lctl.0 00010000:00010000:2.0:1789297339.591863:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297339.591892:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bda4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57daf8 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.591983:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bdab lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.591997:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.592010:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297339.592049:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789297339.592054:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297339.592077:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bdab lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.592101:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bda4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daf8 expref: 16 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.592132:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bdab lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daf8 expref: 15 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.592141:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:2.0:1789297339.592144:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297339.592148:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256200, rc 0) 00000100:00100000:2.0:1789297339.592216:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+15:11380:x1876213933080448:12345-192.168.202.43@tcp:101:lctl.0 Request processed in 385us (643us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297339.592224:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 141 00000100:00100000:1.0:1789297339.679420:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297339.680993:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933080576 00000100:00100000:3.0:1789297339.681009:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933080576 00000100:00100000:2.0:1789297339.681358:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:2.0:1789297339.681372:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+15:11386:x1876213933080576:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297339.681422:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297339.681452:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bdb2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57daff expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681521:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681536:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681548:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681562:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681570:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681577:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681689:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bdc7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681698:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681742:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297339.681772:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789297339.681958:0:5843:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297339.681984:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bdc7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.681997:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682003:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682009:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682015:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297339.682019:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682027:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682039:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:2.0:1789297339.682042:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.682047:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682053:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bdb9 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682066:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682073:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682090:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682096:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297339.682099:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682105:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682260:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff982b2ac85200) 00010000:00010000:2.0:1789297339.682263:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.682267:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682272:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0bdc0 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682308:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bdb2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daff expref: 17 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682321:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bdc7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daff expref: 16 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.682328:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297339.682330:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789297339.682332:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257000, rc 0) 00000100:00100000:2.0:1789297339.682413:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059c8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+16:11386:x1876213933080576:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1045us (3015us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297339.682438:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 142 00000100:00100000:0.0:1789297339.687399:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297339.688292:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933080832 00000100:00100000:2.0:1789297339.688304:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933080832 00000100:00100000:2.0:1789297339.688363:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 143 00000100:00100000:2.0:1789297339.688373:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+16:11386:x1876213933080832:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297339.688394:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297339.688471:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bdce lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db06 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.688611:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.688631:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.688644:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.688661:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.688668:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.688675:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789297339.690569:0:7920:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1789297339.691305:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691341:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691357:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691406:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691488:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691497:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691504:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297339.691509:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691518:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691533:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297339.691536:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.691540:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691546:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0bdd5 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297339.691560:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001b8f0680 reply state 00000000a6dc64a6 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297339.691575:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1789297339.691615:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0bdce lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 19 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691632:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.691641:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:2.0:1789297339.691643:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297339.691646:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257200, rc 0) 00000100:00100000:2.0:1789297339.691844:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+19:11386:x1876213933080832:12345-192.168.202.43@tcp:101:bash.0 Request processed in 3470us (4455us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1789297339.691852:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 143 00010000:00010000:2.0:1789297339.695049:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.695070:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.695079:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.695085:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297339.695091:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.695100:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.695148:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b2ac85900) 00010000:00010000:2.0:1789297339.695151:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297339.695156:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.695162:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0bddc lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297339.697471:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297339.697570:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933080960 00000100:00100000:1.0:1789297339.697581:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933080960 00000100:00080000:3.0:1789297339.697726:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297339.697796:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:1.0:1789297339.697809:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2354:x1876213933080960:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789297339.697845:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297339.697879:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db0d expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1789297339.697913:0:11700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297339.697938:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=351s v=(0 0) 00010000:00010000:1.0:1789297339.697944:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297339.697955:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 6 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297339.697978:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 6 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297339.699317:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2600, rc 0) 00000100:00100000:0.0:1789297339.699504:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933080960:12345-192.168.202.43@tcp:101:bash.0 Request processed in 1694us (2038us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297339.699526:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:1.0:1789297339.702159:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297339.702244:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933081088 00000100:00100000:3.0:1789297339.702255:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933081088 00000100:00100000:3.0:1789297339.702325:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:3.0:1789297339.702334:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+6:11386:x1876213933081088:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789297339.702354:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297339.702371:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db14 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.702405:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 7 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.702413:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297339.702417:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297339.702422:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.702456:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 7 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.702469:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 7 pid: 11700 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297339.702484:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3869a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1876213957205760:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297339.702580:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789297339.705629:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3869a300 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6687:1876213957205760:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297339.705667:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 7 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.705700:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fa00, rc 0) 00000100:00100000:3.0:1789297339.705791:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259e300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:11386:x1876213933081088:12345-192.168.202.43@tcp:101:bash.0 Request processed in 3456us (3642us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297339.705799:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:0.0:1789297339.714265:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297339.714358:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933081216 00000100:00100000:2.0:1789297339.714370:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933081216 00010000:00010000:2.0:1789297339.714412:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 7 pid: 11700 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297339.714529:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:2.0:1789297339.714541:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933081216:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297339.714559:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297339.714599:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 7 pid: 11700 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.714615:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 7 pid: 11700 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.714643:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000067804207/0x8ad177e823a0bdf1 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db0d expref: 7 pid: 11700 timeout: 451 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.714662:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297339.714681:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297339.714691:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.714749:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.715203:0:5828:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297339.715221:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1876213957205888:192.168.202.43@tcp:105: 00000100:00100000:2.0:1789297339.715399:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d79c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297339.728025:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5828:1876213957205888:192.168.202.43@tcp:105: 00010000:00010000:2.0:1789297339.728058:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297339.728106:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276ce680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933081216:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 13569us (14101us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297339.728125:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:0.0:1789297339.735380:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297339.735469:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933081472 00000100:00100000:3.0:1789297339.735480:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933081472 00000100:00100000:3.0:1789297339.735543:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:3.0:1789297339.735552:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+18:11386:x1876213933081472:12345-192.168.202.43@tcp:35:bash.0 00000001:00080000:3.0:1789297339.736378:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967418 00000100:00100000:3.0:1789297339.736514:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+20:11386:x1876213933081472:12345-192.168.202.43@tcp:35:bash.0 Request processed in 959us (1142us total) trans 4294967419 rc 0/0 00000100:00100000:3.0:1789297339.736523:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00000020:00080000:3.0:1789297339.736528:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1789297339.832488:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297339.832643:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933081728 00000100:00100000:3.0:1789297339.832653:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933081728 00000100:00100000:3.0:1789297339.832752:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 144 00000100:00100000:3.0:1789297339.832764:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+20:11396:x1876213933081728:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297339.832791:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297339.832835:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bdff lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db1b expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297339.832931:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789297339.833057:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bdff lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db1b expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.833088:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:3.0:1789297339.833091:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789297339.833098:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bdff lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db1b expref: 22 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297339.833113:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e000, rc 0) 00000100:00100000:3.0:1789297339.833189:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+21:11396:x1876213933081728:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 427us (710us total) trans 4294967420 rc 301/301 00000100:00100000:3.0:1789297339.833196:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 144 00000100:00100000:1.0:1789297339.844643:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297339.844728:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933081984 00000100:00100000:1.0:1789297339.844739:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933081984 00000100:00100000:1.0:1789297339.844804:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:1.0:1789297339.844823:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:11396:x1876213933081984:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789297339.845370:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+22:11396:x1876213933081984:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 555us (734us total) trans 4294967421 rc 0/0 00000100:00100000:1.0:1789297339.845379:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000001:00080000:0.0:1789297339.893576:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967417 is committed 00000001:00080000:0.0:1789297339.893606:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967420 is committed 00010000:00010000:0.0:1789297339.900827:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297339.989084:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297339.989966:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933082112 00000100:00100000:2.0:1789297339.989981:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933082112 00000100:00100000:2.0:1789297339.990053:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 145 00000100:00100000:2.0:1789297339.990063:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+16:11402:x1876213933082112:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297339.990087:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297339.990108:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be0d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db22 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.990175:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0be14 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.990207:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0be14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.990220:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0be14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297339.990265:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:2.0:1789297339.990270:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297339.990290:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0be14 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.990316:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be0d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db22 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.990334:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0be14 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db22 expref: 17 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297339.990343:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297339.990346:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297339.990349:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256800, rc 0) 00000100:00100000:2.0:1789297339.992684:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+17:11402:x1876213933082112:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 2607us (3594us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297339.992698:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 145 00000100:00100000:3.0:1789297340.022144:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297340.022301:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933082368 00000100:00100000:0.0:1789297340.022316:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933082368 00000100:00100000:0.0:1789297340.022381:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 146 00000100:00100000:0.0:1789297340.022397:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+17:11402:x1876213933082368:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297340.022425:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297340.022447:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0be1b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db29 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.022564:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0be22 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.022579:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0be22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.022592:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0be22 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297340.022603:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1789297340.022767:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0be1b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db29 expref: 20 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.022799:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0be22 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db29 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.022819:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:0.0:1789297340.022822:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297340.022825:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba200, rc 0) 00000100:00100000:0.0:1789297340.022891:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+19:11402:x1876213933082368:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 494us (755us total) trans 4294967422 rc 0/0 00000100:00100000:0.0:1789297340.022898:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 146 00000100:00100000:1.0:1789297340.025626:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.025769:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933082496 00000100:00100000:2.0:1789297340.025781:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933082496 00000100:00100000:2.0:1789297340.025852:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297340.025873:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+19:2354:x1876213933082496:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297340.025889:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297340.025930:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba200/0x8ad177e823a0be22 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db29 expref: 19 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.025951:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:2.0:1789297340.025956:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297340.026020:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:2354:x1876213933082496:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 159us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297340.026028:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789297340.036082:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.036287:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933082752 00000100:00100000:3.0:1789297340.036298:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933082752 00000100:00100000:3.0:1789297340.036370:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:3.0:1789297340.036383:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:11402:x1876213933082752:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297340.036409:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297340.036432:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0be30 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db30 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.036542:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be37 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.036558:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.036570:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be37 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297340.036604:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789297340.036791:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0be30 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db30 expref: 21 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.036820:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db30 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.036830:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:3.0:1789297340.036833:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1789297340.036837:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e000, rc 0) 00000100:00100000:3.0:1789297340.038448:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+20:11402:x1876213933082752:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1318us (1625us total) trans 4294967423 rc 0/0 00000100:00100000:3.0:1789297340.038464:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 147 00000100:00100000:0.0:1789297340.047104:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.050026:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933082880 00000100:00100000:2.0:1789297340.050182:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933082880 00000100:00100000:0.0:1789297340.059157:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:0.0:1789297340.059176:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933082880:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:0.0:1789297340.059237:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.059265:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.059275:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297340.059279:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789297340.059284:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.059332:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 6 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.059371:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 6 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297340.059388:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876213957206016:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297340.059521:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3240 going to sleep for 11 seconds 00000100:00100000:1.0:1789297340.063344:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.063509:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933083008 00000100:00100000:2.0:1789297340.063519:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933083008 00002000:00100000:2.0:1789297340.063574:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff982b3fbb7480 x1876213933083008/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:201/0 lens 504/0 e 0 to 0 dl 1789297351 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789297340.063583:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b3fbb7480 with x1876213933083008 ext(0->12) 00010000:00010000:2.0:1789297340.063591:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 7 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.063604:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 7 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297340.063610:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff982b3fbb7480 00000100:00100000:2.0:1789297340.063638:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:2.0:1789297340.063652:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933083008:12345-192.168.202.43@tcp:4:lfs.0 00000100:00100000:2.0:1789297340.064187:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:2353:x1876213933083008:12345-192.168.202.43@tcp:4:lfs.0 Request processed in 540us (853us total) trans 4294967305 rc 0/0 00000100:00100000:2.0:1789297340.064195:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00002000:00100000:2.0:1789297340.064209:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff982b3fbb7480 x1876213933083008/t4294967305(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:201/0 lens 504/448 e 0 to 0 dl 1789297351 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:2.0:1789297340.064218:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b3fbb7480 with x1876213933083008 ext(0->12) 00010000:00010000:2.0:1789297340.064224:0:6694:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 9 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.064237:0:6694:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 9 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297340.064244:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff982b3fbb7480 00000100:00100000:0.0:1789297340.064755:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6689:1876213957206016:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297340.064777:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297340.067344:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297340.067438:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933083136 00000100:00100000:0.0:1789297340.067447:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933083136 00010000:00010000:0.0:1789297340.067482:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 9 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297340.067517:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:0.0:1789297340.067525:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+9:2354:x1876213933083136:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297340.067543:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1789297340.067563:0:5827:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1789297340.067566:0:5827:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1789297340 00002000:00010000:0.0:1789297340.067569:0:5827:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1789297340 00002000:00010000:0.0:1789297340.067571:0:5827:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1789297340 00010000:00010000:0.0:1789297340.067577:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 9 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.067610:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 9 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.067634:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0bdf8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db14 expref: 9 pid: 6687 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.067653:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789297340.067656:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789297340.067660:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.067668:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.067697:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297340.067779:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38699880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933083136:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 252us (443us total) trans 0 rc 0/0 00010000:00010000:1.0:1789297340.067780:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297340.067789:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00010000:00010000:1.0:1789297340.067799:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.067838:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.067848:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.067878:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.067885:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297340.067890:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.067898:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.067910:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.067917:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0be45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297340.067971:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933082880:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 8800us (20939us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297340.067979:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:0.0:1789297340.077307:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.077359:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933083392 00000100:00100000:3.0:1789297340.077372:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933083392 00000100:00100000:3.0:1789297340.077443:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:3.0:1789297340.077455:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13010450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+20:11402:x1876213933083392:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:2.0:1789297340.077603:0:5846:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be37 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db30 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789297340.077958:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:2.0:1789297340.078010:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00000001:00080000:2.0:1789297340.078699:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00010000:00010000:2.0:1789297340.078791:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.078818:0:5846:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 24 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.078828:0:5846:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.078867:0:5846:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 24 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.078883:0:5846:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 24 pid: 7920 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297340.078908:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876213957206144:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297340.079041:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7480 going to sleep for 11 seconds 00000100:00100000:0.0:1789297340.081913:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.083751:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5846:1876213957206144:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297340.083778:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933083520 00000100:00100000:1.0:1789297340.083787:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933083520 00010000:00010000:2.0:1789297340.083799:0:5846:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.083834:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 25 pid: 7920 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297340.083883:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:1.0:1789297340.083908:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+25:2354:x1876213933083520:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297340.083924:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297340.083932:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 25 pid: 7920 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.083945:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 25 pid: 7920 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.083968:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bde3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db06 expref: 25 pid: 7920 timeout: 451 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.083982:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:1.0:1789297340.083987:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.083996:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.084003:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.084030:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297340.084105:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02f3f850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+24:2354:x1876213933083520:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 198us (2203us total) trans 0 rc 0/0 00010000:00010000:2.0:1789297340.084126:0:5846:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.084138:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789297340.084276:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000001:00080000:2.0:1789297340.084512:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:2.0:1789297340.084612:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957206272:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789297340.084682:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297340.084753:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789297340.086580:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957206272 00000100:00100000:0.0:1789297340.086593:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957206272 00000100:00100000:0.0:1789297340.086671:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789297340.086694:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957206272:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00080000:2.0:1789297340.086729:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789297340.086854:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957206272:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 174us (2170us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297340.086995:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789297340.087187:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957206272:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789297340.088378:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00000100:00100000:2.0:1789297340.088480:0:5846:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957206400:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1789297340.088545:0:5846:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297340.088579:0:5846:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7480 going to sleep for 11 seconds 00000100:00100000:1.0:1789297340.088591:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:0.0:1789297340.088727:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957206400 00000100:00100000:0.0:1789297340.088734:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957206400 00000100:00100000:0.0:1789297340.088779:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789297340.088788:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5846:x1876213957206400:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1789297340.089007:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5846:x1876213957206400:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 219us (461us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1789297340.089015:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789297340.089154:0:5846:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af6680 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5846:1876213957206400:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1789297340.089222:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:2.0:1789297340.089274:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.089286:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.089306:0:5846:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.089313:0:5846:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297340.089317:0:5846:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.089325:0:5846:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.089344:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:2.0:1789297340.089348:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1789297340.089353:0:5846:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.089360:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0be4c lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789297340.089561:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1789297340.089853:0:5846:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:2.0:1789297340.089868:0:5846:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 351964162982ns, next at 352964160266ns, rc = 0 00000001:00080000:2.0:1789297340.089876:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967431 00010000:00010000:2.0:1789297340.089909:0:5846:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:2.0:1789297340.089913:0:5846:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789297340.089920:0:5846:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be37 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db30 expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297340.090047:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13010450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+27:11402:x1876213933083392:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 12595us (12762us total) trans 4294967432 rc 0/0 00000100:00100000:2.0:1789297340.090055:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00000020:00080000:2.0:1789297340.090060:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1789297340.095216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.096051:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933083648 00000100:00100000:3.0:1789297340.096064:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933083648 00000100:00100000:3.0:1789297340.096153:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 148 00000100:00100000:3.0:1789297340.096166:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+27:11402:x1876213933083648:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297340.096193:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297340.096218:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0be53 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db37 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.096319:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0be53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db37 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.096338:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0be53 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db37 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.096360:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297340.096364:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1789297340.096368:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148ea00, rc 0) 00000100:00100000:3.0:1789297340.096441:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+28:11402:x1876213933083648:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 278us (1235us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297340.096448:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 148 00000100:00100000:0.0:1789297340.104598:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.104684:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933083904 00000100:00100000:2.0:1789297340.104697:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933083904 00000100:00100000:2.0:1789297340.104815:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:2.0:1789297340.104828:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+28:11402:x1876213933083904:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789297340.105074:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+29:11402:x1876213933083904:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 247us (487us total) trans 4294967433 rc 0/0 00000100:00100000:2.0:1789297340.105081:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:2.0:1789297340.216064:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297340.216262:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933084160 00000100:00100000:1.0:1789297340.216276:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933084160 00000100:00100000:1.0:1789297340.216563:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 149 00000100:00100000:1.0:1789297340.216575:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+29:11412:x1876213933084160:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297340.216615:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297340.216638:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0be5a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db3e expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297340.216763:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789297340.216986:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0be5a lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db3e expref: 31 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.217001:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:1.0:1789297340.217004:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789297340.217009:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0be5a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db3e expref: 31 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.217024:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3600, rc 0) 00000100:00100000:1.0:1789297340.217142:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+30:11412:x1876213933084160:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 569us (1089us total) trans 4294967434 rc 301/301 00000100:00100000:1.0:1789297340.217149:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 149 00000100:00100000:0.0:1789297340.225287:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.225671:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933084288 00000100:00100000:3.0:1789297340.225684:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933084288 00000100:00100000:3.0:1789297340.225989:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 150 00000100:00100000:3.0:1789297340.226000:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+30:11412:x1876213933084288:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:3.0:1789297340.226250:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226268:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226282:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226314:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226342:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226350:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226646:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226655:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.226662:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297340.227022:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227038:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227044:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227050:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227056:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297340.227060:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227068:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227118:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297340.227121:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297340.227126:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227131:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be68 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227146:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227152:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227158:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227164:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297340.227167:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227173:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227180:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b03073a00) 00010000:00010000:3.0:1789297340.227182:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297340.227185:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227191:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be6f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227223:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227230:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227235:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227240:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297340.227243:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227249:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227256:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297340.227258:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297340.227261:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.227267:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be76 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297340.227372:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+30:11412:x1876213933084288:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 1370us (2092us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297340.227380:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 150 00000100:00100000:2.0:1789297340.239099:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297340.241032:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933084544 00000100:00100000:1.0:1789297340.241048:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933084544 00000100:00100000:1.0:1789297340.241161:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:1.0:1789297340.241174:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+30:11412:x1876213933084544:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789297340.241486:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+31:11412:x1876213933084544:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 314us (2394us total) trans 4294967435 rc 0/0 00000100:00100000:1.0:1789297340.241494:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:2.0:1789297340.306984:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.307355:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933084800 00000100:00100000:3.0:1789297340.307366:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933084800 00000100:00100000:3.0:1789297340.307670:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 151 00000100:00100000:3.0:1789297340.307699:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+31:11415:x1876213933084800:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297340.307769:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297340.307790:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be7d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db45 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.307886:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.307900:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.307911:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.307924:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.307930:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.307936:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308207:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308216:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308223:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297340.308242:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789297340.308339:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308347:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308353:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308359:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297340.308363:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308371:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308384:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297340.308387:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297340.308392:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308398:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0be84 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308428:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308435:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308453:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308458:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297340.308461:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308466:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308475:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b03073a00) 00010000:00010000:3.0:1789297340.308477:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297340.308480:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308485:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0be8b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308540:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0be7d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 34 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308556:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 33 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.308563:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297340.308566:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297340.308568:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fa00, rc 0) 00000100:00100000:3.0:1789297340.308642:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+33:11415:x1876213933084800:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 946us (1666us total) trans 4294967436 rc 0/0 00000100:00100000:3.0:1789297340.308657:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 151 00000100:00100000:1.0:1789297340.319989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.321866:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933084928 00000100:00100000:2.0:1789297340.321881:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933084928 00000100:00100000:2.0:1789297340.321952:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00100000:2.0:1789297340.321962:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+33:11415:x1876213933084928:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789297340.322036:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322055:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322069:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322116:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322123:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322130:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322137:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297340.322141:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322149:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322161:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297340.322164:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789297340.322168:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.322175:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bea0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297340.322267:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+33:11415:x1876213933084928:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 305us (2290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297340.322274:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 152 00000100:00100000:2.0:1789297340.326103:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.326180:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933085184 00000100:00100000:3.0:1789297340.326192:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933085184 00000100:00100000:3.0:1789297340.326257:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789297340.326270:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+33:11415:x1876213933085184:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297340.326669:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+34:11415:x1876213933085184:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 400us (575us total) trans 4294967437 rc 0/0 00000100:00100000:3.0:1789297340.326677:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:3.0:1789297340.349143:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957206528:0@lo:400:kworker.0 00000100:00100000:3.0:1789297340.349253:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297340.349396:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957206528 00000100:00100000:0.0:1789297340.349423:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957206528 00000100:00100000:0.0:1789297340.349483:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:0.0:1789297340.349495:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957206528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297340.350687:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957206656:0@lo:400:kworker.0 00000100:00100000:1.0:1789297340.350775:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297340.350852:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957206656 00000100:00100000:1.0:1789297340.350859:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957206656 00000100:00100000:1.0:1789297340.350902:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789297340.350909:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957206656:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297340.350955:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957206656:12345-0@lo:400:kworker.0 Request processed in 46us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297340.350963:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:1.0:1789297340.351004:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957206656:0@lo:400:kworker.0 00000100:00100000:0.0:1789297340.356196:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12154c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3304:x1876213957206528:12345-0@lo:400:kworker.0 Request processed in 6692us (6931us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297340.356213:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:3.0:1789297340.357615:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3304:1876213957206528:0@lo:400:kworker.0 00000100:00100000:3.0:1789297340.358953:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957206784:0@lo:400:kworker.0 00000100:00100000:3.0:1789297340.359096:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297340.359198:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957206784 00000100:00100000:0.0:1789297340.359208:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957206784 00000100:00100000:0.0:1789297340.359282:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:0.0:1789297340.359303:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957206784:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1789297340.359443:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297340.361279:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957206912:0@lo:400:kworker.0 00000100:00100000:3.0:1789297340.361353:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297340.361423:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957206912 00000100:00100000:3.0:1789297340.361431:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957206912 00000100:00100000:3.0:1789297340.361486:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789297340.361496:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876213957206912:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297340.361588:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3303:x1876213957206912:12345-0@lo:400:kworker.0 Request processed in 93us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297340.361596:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1789297340.361642:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957206912:0@lo:400:kworker.0 00000100:00100000:0.0:1789297340.365893:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957206784:12345-0@lo:400:kworker.0 Request processed in 6591us (6785us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297340.365910:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1789297340.368970:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957207040:0@lo:400:kworker.0 00000100:00100000:3.0:1789297340.369058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297340.370002:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957207168:0@lo:400:kworker.0 00000100:00100000:0.0:1789297340.370073:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297340.370131:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957207168 00000100:00100000:0.0:1789297340.370141:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957207168 00000100:00100000:0.0:1789297340.370208:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1789297340.370217:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957207168:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297340.370278:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957207168:12345-0@lo:400:kworker.0 Request processed in 61us (204us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297340.370287:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00080000:0.0:1789297340.370328:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297340.370362:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957207168:0@lo:400:kworker.0 00000100:00100000:1.0:1789297340.371378:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957206784:0@lo:400:kworker.0 00000100:00100000:1.0:1789297340.371432:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957207040 00000100:00100000:1.0:1789297340.371438:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957207040 00000100:00100000:1.0:1789297340.371490:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:1.0:1789297340.371498:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957207040:12345-0@lo:400:kworker.0 00000100:00080000:0.0:1789297340.371655:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297340.378753:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957207040:12345-0@lo:400:kworker.0 Request processed in 7243us (9682us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297340.378771:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1789297340.381041:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957207040:0@lo:400:kworker.0 00000100:00100000:1.0:1789297340.623980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.624048:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933085440 00000100:00100000:3.0:1789297340.624061:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933085440 00000100:00100000:3.0:1789297340.624185:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 153 00000100:00100000:3.0:1789297340.624206:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+34:11446:x1876213933085440:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:3.0:1789297340.624233:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297340.624254:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bea7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db4c expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.624356:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0beae lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.624371:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0beae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.624383:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0beae lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297340.624393:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1789297340.624765:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bea7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db4c expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.624921:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0beae lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db4c expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297340.624930:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297340.624948:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297340.624952:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e800, rc 0) 00000100:00100000:3.0:1789297340.625022:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+36:11446:x1876213933085440:12345-192.168.202.43@tcp:101:cat.0 Request processed in 820us (1050us total) trans 4294967438 rc 0/0 00000100:00100000:3.0:1789297340.625030:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 153 00000100:00100000:2.0:1789297340.629842:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.629894:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.630011:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933085696 00000100:00100000:3.0:1789297340.630081:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933085696 00000100:00100000:3.0:1789297340.630185:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:3.0:1789297340.630199:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+36:11446:x1876213933085696:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:3.0:1789297340.630856:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+37:11446:x1876213933085696:12345-192.168.202.43@tcp:35:cat.0 Request processed in 658us (1093us total) trans 4294967439 rc 0/0 00000100:00100000:3.0:1789297340.630865:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789297340.630927:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933085824 00000100:00100000:0.0:1789297340.630932:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933085824 00000100:00100000:0.0:1789297340.630964:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:0.0:1789297340.630969:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+37:2354:x1876213933085824:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297340.630978:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297340.631001:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0beae lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db4c expref: 37 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.631025:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:0.0:1789297340.631029:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297340.631045:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+36:2354:x1876213933085824:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 77us (1153us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297340.631050:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789297340.700144:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297340.702381:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933086080 00000100:00100000:0.0:1789297340.702396:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933086080 00000100:00100000:2.0:1789297340.702619:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 154 00000100:00100000:2.0:1789297340.702631:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+36:11452:x1876213933086080:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:2.0:1789297340.702656:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297340.702660:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789297340.702685:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0be14 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db22 expref: 36 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.702723:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297340.702728:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789297340.702742:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0bebc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db53 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.703110:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.703125:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.703134:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.703187:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.703202:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 36 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297340.703217:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957207296:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297340.703360:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7c00 going to sleep for 11 seconds 00000100:00100000:2.0:1789297340.708075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297340.708173:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957207296:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297340.708204:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297340.708207:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933086208 00000100:00100000:1.0:1789297340.708215:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933086208 00010000:00010000:1.0:1789297340.708253:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 37 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297340.708295:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:1.0:1789297340.708305:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+37:2353:x1876213933086208:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297340.708339:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297340.708346:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 37 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.708358:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 37 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.708381:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0be92 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db45 expref: 37 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.708396:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297340.708401:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.708410:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.708418:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.708448:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297340.708505:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+36:2353:x1876213933086208:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 201us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297340.708513:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00010000:00010000:2.0:1789297340.708523:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.708595:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297340.708614:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1789297340.708789:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0bebc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.709074:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 36 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.709083:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297340.709086:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297340.709088:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256e00, rc 0) 00000100:00100000:2.0:1789297340.709165:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+36:11452:x1876213933086080:12345-192.168.202.43@tcp:101:dd.0 Request processed in 6536us (9031us total) trans 4294967440 rc 0/0 00000100:00100000:2.0:1789297340.709172:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 154 00000100:00100000:3.0:1789297340.713468:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297340.713541:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933086464 00000100:00100000:0.0:1789297340.713566:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933086464 00000100:00100000:0.0:1789297340.713640:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 155 00000100:00100000:0.0:1789297340.713650:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+36:11452:x1876213933086464:12345-192.168.202.43@tcp:36:dd.0 00010000:00010000:0.0:1789297340.713968:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.713987:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.713998:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789297340.714066:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967441 00000004:00010000:0.0:1789297340.714092:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b0aa8bfa reply state 00000000fd7c6c8c transno 4294967442 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297340.714101:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789297340.714782:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38699180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+39:11452:x1876213933086464:12345-192.168.202.43@tcp:36:dd.0 Request processed in 1129us (1376us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1789297340.714791:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 155 00000020:00080000:0.0:1789297340.714796:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789297340.720590:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.720608:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.720616:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.720643:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297340.720648:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.720655:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.720673:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297340.720676:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297340.720680:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.720685:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bed1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297340.861168:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3fbb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957207424:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297340.861248:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297340.861379:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957207424 00000100:00100000:3.0:1789297340.861388:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957207424 00000100:00100000:3.0:1789297340.861458:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789297340.861469:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957207424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297340.861507:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297340.867968:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957207424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 6492us (6710us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297340.867985:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789297340.871323:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3fbb6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957207424:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1789297340.924982:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297340.980436:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297340.980765:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933086592 00000100:00100000:2.0:1789297340.980776:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933086592 00000100:00100000:2.0:1789297340.980856:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 156 00000100:00100000:2.0:1789297340.980867:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+38:11466:x1876213933086592:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:2.0:1789297340.980893:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297340.980914:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0bed8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db5a expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.980977:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981004:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981015:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981032:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981040:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981046:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981278:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981289:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981298:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981329:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297340.981343:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 39 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297340.981368:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957207552:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297340.982333:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7780 going to sleep for 11 seconds 00000100:00100000:3.0:1789297340.986876:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297340.986975:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933086848 00000100:00100000:1.0:1789297340.986986:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933086848 00000100:00100000:1.0:1789297340.987044:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:1.0:1789297340.987054:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+40:5594:x1876213933086848:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789297340.987419:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+41:5594:x1876213933086848:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 365us (553us total) trans 4294967443 rc 0/0 00000100:00100000:1.0:1789297340.987427:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:2.0:1789297340.988885:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957207552:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297340.988916:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297340.990910:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297340.991106:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933086976 00000100:00100000:0.0:1789297340.991116:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933086976 00010000:00010000:0.0:1789297340.991166:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 41 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297340.991209:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:0.0:1789297340.991219:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+41:2354:x1876213933086976:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297340.991235:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297340.991257:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 41 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.991269:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 41 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.991292:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0bec3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db53 expref: 41 pid: 5842 timeout: 452 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.991308:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:0.0:1789297340.991312:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.991321:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.991328:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297340.991361:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297340.991496:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991507:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297340.991570:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789297340.991585:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297340.991613:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991626:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991634:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991641:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991648:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991654:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297340.991658:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991676:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991686:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297340.991689:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297340.991693:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991699:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0bedf lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991743:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991749:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991756:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991761:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297340.991765:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991770:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991778:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b2ac85200) 00010000:00010000:1.0:1789297340.991780:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297340.991783:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991808:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0bee6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991848:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0bed8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db5a expref: 41 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991862:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db5a expref: 40 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297340.991870:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297340.991872:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297340.991875:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256600, rc 0) 00000100:00100000:0.0:1789297340.992262:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+40:2354:x1876213933086976:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 1041us (1358us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297340.992271:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789297340.993022:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+39:11466:x1876213933086592:12345-192.168.202.43@tcp:101:stat.0 Request processed in 12151us (12590us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297340.993031:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 156 00000100:00100000:0.0:1789297341.059295:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.059397:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933087232 00000100:00100000:1.0:1789297341.059422:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933087232 00000100:00100000:1.0:1789297341.059501:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 157 00000100:00100000:1.0:1789297341.059513:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+39:11472:x1876213933087232:12345-192.168.202.43@tcp:36:truncate.0 00010000:00010000:1.0:1789297341.059587:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297341.059615:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0beed lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db5a expref: 39 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.059634:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297341.059639:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297341.059911:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.059939:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.059949:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789297341.060005:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967444 00000004:00010000:1.0:1789297341.060031:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000005feadc8 reply state 00000000fa707a72 transno 4294967445 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297341.060039:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789297341.060132:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+41:11472:x1876213933087232:12345-192.168.202.43@tcp:36:truncate.0 Request processed in 621us (849us total) trans 4294967445 rc 0/0 00000100:00100000:1.0:1789297341.060140:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 157 00000020:00080000:1.0:1789297341.060145:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00080000:0.0:1789297341.060778:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789297341.064312:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.064332:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.064341:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.064348:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297341.064353:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.064362:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.064380:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297341.064384:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297341.064388:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.064395:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0bef4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297341.202907:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297341.203015:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933087360 00000100:00100000:3.0:1789297341.203038:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933087360 00000100:00100000:3.0:1789297341.203109:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 158 00000100:00100000:3.0:1789297341.203121:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+40:11486:x1876213933087360:12345-192.168.202.43@tcp:101:stat.0 00010000:00010000:3.0:1789297341.203146:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297341.203166:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0befb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db61 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203239:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203253:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203266:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203280:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203288:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203295:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203538:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203546:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203553:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297341.203608:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:3.0:1789297341.203613:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297341.203634:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203646:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203654:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203661:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203668:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203675:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297341.203679:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203687:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203699:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297341.203740:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297341.203744:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203751:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bf02 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203775:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203781:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203787:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203792:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297341.203795:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203813:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203821:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b03073a00) 00010000:00010000:3.0:1789297341.203824:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297341.203826:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203831:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf09 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203868:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0befb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 42 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203883:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 41 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.203903:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297341.203905:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297341.203907:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e400, rc 0) 00000100:00100000:3.0:1789297341.203981:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276ce680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+41:11486:x1876213933087360:12345-192.168.202.43@tcp:101:stat.0 Request processed in 862us (1084us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297341.203988:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 158 00000100:00100000:3.0:1789297341.285848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.286896:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933087616 00000100:00100000:1.0:1789297341.286907:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933087616 00000100:00100000:1.0:1789297341.286977:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 159 00000100:00100000:1.0:1789297341.286987:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+41:11496:x1876213933087616:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297341.287013:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297341.287034:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf17 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db68 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297341.287131:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789297341.287275:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf17 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db68 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.287290:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:1.0:1789297341.287319:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789297341.287325:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf17 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db68 expref: 43 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.287340:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3600, rc 0) 00000100:00100000:1.0:1789297341.287411:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+42:11496:x1876213933087616:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 425us (1575us total) trans 4294967446 rc 301/301 00000100:00100000:1.0:1789297341.287419:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 159 00000100:00100000:0.0:1789297341.300887:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.300976:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933087872 00000100:00100000:1.0:1789297341.300987:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933087872 00000100:00100000:1.0:1789297341.301036:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:1.0:1789297341.301043:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13012450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+42:11496:x1876213933087872:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789297341.301276:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13012450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+43:11496:x1876213933087872:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 231us (400us total) trans 4294967447 rc 0/0 00000100:00100000:1.0:1789297341.301283:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:0.0:1789297341.365970:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297341.366082:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933088128 00000100:00100000:3.0:1789297341.366093:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933088128 00000100:00100000:3.0:1789297341.366176:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 160 00000100:00100000:3.0:1789297341.366188:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+43:11502:x1876213933088128:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789297341.366218:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297341.366243:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bf25 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db6f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.366349:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.366365:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.366374:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.366421:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.366455:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 44 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297341.366469:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38698380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957207680:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297341.366579:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063afd80 going to sleep for 11 seconds 00000100:00100000:3.0:1789297341.369773:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38698380 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957207680:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297341.369822:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297341.370502:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.370607:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933088256 00000100:00100000:1.0:1789297341.370616:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933088256 00010000:00010000:1.0:1789297341.370656:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 45 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297341.370695:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:1.0:1789297341.370738:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+45:2353:x1876213933088256:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297341.370752:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297341.370759:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 45 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.370771:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 45 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.370812:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bf10 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db61 expref: 45 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.370828:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297341.370833:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.370841:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.370848:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.370878:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297341.370924:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38692680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+44:2353:x1876213933088256:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 220us (424us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297341.370931:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00010000:00010000:2.0:1789297341.371098:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.371107:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297341.371125:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1789297341.371290:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bf25 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 45 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.371306:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 44 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.371313:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297341.371316:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297341.371318:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f800, rc 0) 00000100:00100000:2.0:1789297341.371345:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+44:11502:x1876213933088128:12345-192.168.202.43@tcp:101:bash.0 Request processed in 5161us (5387us total) trans 4294967448 rc 0/0 00000100:00100000:2.0:1789297341.371351:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 160 00000004:00080000:1.0:1789297341.373898:0:7162:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 353248190796ns, next at 354248187879ns, rc = 0 00000100:00100000:2.0:1789297341.374250:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1789297341.374273:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3fbb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957207808:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297341.374360:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297341.375137:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957207808 00000100:00100000:3.0:1789297341.375148:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957207808 00000100:00100000:3.0:1789297341.375220:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789297341.375233:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3837ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957207808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297341.375274:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297341.375340:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3837ac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3302:x1876213957207808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 111us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297341.375348:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789297341.375745:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3fbb7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957207808:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1789297341.376027:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.376406:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933088512 00000100:00100000:1.0:1789297341.376413:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933088512 00000100:00100000:1.0:1789297341.376461:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 161 00000100:00100000:1.0:1789297341.376470:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+44:11502:x1876213933088512:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:1.0:1789297341.376827:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.376847:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.376869:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789297341.376925:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967449 00000004:00010000:1.0:1789297341.376949:0:5843:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d799a7b5 reply state 0000000090cc5bd0 transno 4294967450 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297341.376957:0:5843:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789297341.377036:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38691500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+47:11502:x1876213933088512:12345-192.168.202.43@tcp:36:bash.0 Request processed in 566us (1010us total) trans 4294967450 rc 0/0 00000100:00100000:1.0:1789297341.377043:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 161 00000020:00080000:1.0:1789297341.377048:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789297341.382115:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.382134:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.382161:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.382168:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297341.382173:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.382181:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.382199:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297341.382202:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297341.382207:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.382212:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0bf3a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297341.383349:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.383978:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933088640 00000100:00100000:1.0:1789297341.383990:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933088640 00000100:00100000:1.0:1789297341.384058:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00100000:1.0:1789297341.384070:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+46:11502:x1876213933088640:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789297341.384090:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297341.384110:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bf41 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db76 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.384192:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.384207:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.384217:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.384271:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.384285:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 47 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297341.384297:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3fbb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957207936:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297341.384818:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7240 going to sleep for 11 seconds 00000100:00100000:0.0:1789297341.390337:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.390463:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3fbb7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957207936:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297341.390493:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297341.390833:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933088768 00000100:00100000:2.0:1789297341.390842:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933088768 00010000:00010000:2.0:1789297341.390885:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 48 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297341.390961:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:2.0:1789297341.390971:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+48:2353:x1876213933088768:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297341.390986:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297341.390993:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 48 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.391042:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 48 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.391067:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bf2c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db6f expref: 48 pid: 5842 timeout: 453 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.391085:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297341.391090:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.391098:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.391105:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.391134:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297341.391352:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.391360:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297341.391421:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789297341.391425:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297341.391447:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.391478:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bf41 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db76 expref: 48 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.391495:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db76 expref: 47 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.391516:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297341.391532:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297341.391535:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3000, rc 0) 00000100:00100000:2.0:1789297341.391589:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38693100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+47:2353:x1876213933088768:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 617us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297341.391599:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:1.0:1789297341.392170:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38693b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+46:11502:x1876213933088640:12345-192.168.202.43@tcp:101:bash.0 Request processed in 8086us (8812us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297341.392179:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 162 00000100:00100000:3.0:1789297341.396261:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.396328:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933089024 00000100:00100000:1.0:1789297341.396340:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933089024 00000100:00100000:1.0:1789297341.396417:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:1.0:1789297341.396428:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+46:11502:x1876213933089024:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:1.0:1789297341.397410:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+47:11502:x1876213933089024:12345-192.168.202.43@tcp:35:bash.0 Request processed in 968us (1143us total) trans 4294967451 rc 0/0 00000100:00100000:1.0:1789297341.397421:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:3.0:1789297341.480596:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.480760:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933089280 00000100:00100000:1.0:1789297341.480774:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933089280 00000100:00100000:1.0:1789297341.480855:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:1.0:1789297341.480867:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+47:11513:x1876213933089280:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297341.480894:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297341.480918:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bf4f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db7d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297341.481028:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:1.0:1789297341.481183:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bf4f lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db7d expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.481221:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:1.0:1789297341.481224:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789297341.481229:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bf4f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db7d expref: 49 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.481243:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2000, rc 0) 00000100:00100000:1.0:1789297341.481309:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38699880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+48:11513:x1876213933089280:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 444us (725us total) trans 4294967452 rc 301/301 00000100:00100000:1.0:1789297341.481316:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 163 00000100:00100000:0.0:1789297341.484760:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297341.484869:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933089408 00000100:00100000:2.0:1789297341.484880:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933089408 00000100:00100000:2.0:1789297341.484938:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:2.0:1789297341.484948:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+48:11513:x1876213933089408:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789297341.485031:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485050:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485079:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485094:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485101:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485107:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485385:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485395:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485403:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297341.485451:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485464:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485470:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485477:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485496:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297341.485500:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485508:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485522:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297341.485525:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297341.485530:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485536:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0bf5d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485549:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485554:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485561:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485566:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297341.485569:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485575:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485593:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b2ac85900) 00010000:00010000:2.0:1789297341.485596:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297341.485598:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485604:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf64 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485618:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485624:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485630:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485635:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297341.485637:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485643:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485650:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297341.485651:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297341.485654:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.485658:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0bf6b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297341.485812:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38691c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+48:11513:x1876213933089408:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 863us (1063us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297341.485821:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:2.0:1789297341.489615:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297341.489693:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933089664 00000100:00100000:3.0:1789297341.489730:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933089664 00000100:00100000:3.0:1789297341.489816:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789297341.489827:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+48:11513:x1876213933089664:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297341.490052:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+49:11513:x1876213933089664:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 227us (451us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1789297341.490077:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:3.0:1789297341.527982:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.528121:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933089920 00000100:00100000:1.0:1789297341.528134:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933089920 00000100:00100000:1.0:1789297341.528207:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:1.0:1789297341.528219:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+49:11516:x1876213933089920:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297341.528246:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297341.528272:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bf72 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db84 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528361:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528378:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528390:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528405:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528425:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528433:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528785:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bf87 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528809:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bf87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528817:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bf87 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297341.528829:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789297341.528937:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528945:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528952:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528958:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297341.528963:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528971:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.528996:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297341.528999:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297341.529004:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529011:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bf79 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529025:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529032:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529037:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529043:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297341.529046:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529052:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529060:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b08585400) 00010000:00010000:1.0:1789297341.529062:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297341.529065:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529070:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bf80 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529132:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bf72 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db84 expref: 52 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529148:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bf87 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db84 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.529156:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297341.529158:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297341.529161:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2200, rc 0) 00000100:00100000:1.0:1789297341.529243:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:11516:x1876213933089920:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1027us (1273us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1789297341.529251:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:0.0:1789297341.541830:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297341.541875:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.541981:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933090048 00000100:00100000:1.0:1789297341.541993:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933090048 00000100:00100000:1.0:1789297341.542070:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789297341.542081:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+51:2353:x1876213933090048:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297341.542100:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297341.542130:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bf87 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db84 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.542162:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297341.542167:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297341.542235:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38692d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+50:2353:x1876213933090048:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 156us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297341.542242:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:2.0:1789297341.542417:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933090176 00000100:00100000:2.0:1789297341.542422:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933090176 00000100:00100000:2.0:1789297341.542460:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 166 00000100:00100000:2.0:1789297341.542468:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+50:11516:x1876213933090176:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789297341.542546:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542562:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542572:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542608:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542615:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542645:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542651:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297341.542656:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542676:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542693:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297341.542696:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789297341.542701:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297341.542744:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0bf95 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297341.542812:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38691f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+50:11516:x1876213933090176:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 329us (920us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297341.542819:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 166 00000100:00100000:2.0:1789297341.545929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297341.546119:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933090432 00000100:00100000:3.0:1789297341.546130:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933090432 00000100:00100000:3.0:1789297341.546201:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:3.0:1789297341.546212:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+50:11516:x1876213933090432:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297341.546519:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:11516:x1876213933090432:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 308us (599us total) trans 4294967455 rc 0/0 00000100:00100000:3.0:1789297341.546536:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:0.0:1789297341.718205:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.718321:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933090688 00000100:00100000:1.0:1789297341.718332:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933090688 00000100:00100000:1.0:1789297341.718410:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 167 00000100:00100000:1.0:1789297341.718420:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:11534:x1876213933090688:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:1.0:1789297341.718447:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297341.718469:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bf9c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db8b expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.718926:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bfa3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.718944:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bfa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.718955:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bfa3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297341.718966:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789297341.719101:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bf9c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db8b expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.719120:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bfa3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db8b expref: 53 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.719129:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297341.719131:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:1.0:1789297341.719135:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2000, rc 0) 00000100:00100000:1.0:1789297341.719206:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38693800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+53:11534:x1876213933090688:12345-192.168.202.43@tcp:101:cat.0 Request processed in 787us (1013us total) trans 4294967456 rc 0/0 00000100:00100000:1.0:1789297341.719231:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 167 00000100:00100000:0.0:1789297341.750780:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297341.751684:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933090816 00000100:00100000:2.0:1789297341.751695:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933090816 00000100:00100000:3.0:1789297341.752067:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 168 00000100:00100000:3.0:1789297341.752090:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+53:11535:x1876213933090816:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297341.752116:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297341.752137:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfb1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db92 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.752206:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bfb8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.752220:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.752231:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297341.752267:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789297341.752271:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297341.752289:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bfb8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.752334:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfb1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db92 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.752353:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bfb8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db92 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.752362:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297341.752365:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297341.752368:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148f800, rc 0) 00000100:00100000:3.0:1789297341.752445:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38690e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+54:11535:x1876213933090816:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 366us (1672us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297341.752452:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 168 00000100:00100000:2.0:1789297341.764231:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297341.764319:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933091200 00000100:00100000:3.0:1789297341.764331:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933091200 00000100:00100000:3.0:1789297341.764418:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:3.0:1789297341.764431:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+54:11535:x1876213933091200:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297341.764818:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+55:11535:x1876213933091200:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 389us (597us total) trans 4294967457 rc 0/0 00000100:00100000:3.0:1789297341.764827:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:0.0:1789297341.776680:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297341.777082:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933091328 00000100:00100000:3.0:1789297341.777093:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933091328 00000100:00100000:3.0:1789297341.777173:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:3.0:1789297341.777186:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02e83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+55:11535:x1876213933091328:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:3.0:1789297341.777205:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:3.0:1789297341.777229:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0bf48 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db76 expref: 55 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.777269:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0bfa3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db8b expref: 54 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.777281:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0be53 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db37 expref: 53 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.777291:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297341.777306:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297341.777378:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02e83850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+52:11535:x1876213933091328:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 195us (707us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297341.777385:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:0.0:1789297341.784929:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297341.784997:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933091456 00000100:00100000:3.0:1789297341.785008:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933091456 00000100:00100000:3.0:1789297341.785074:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 169 00000100:00100000:3.0:1789297341.785084:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+52:11535:x1876213933091456:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:3.0:1789297341.785182:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.785199:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297341.785211:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789297341.785422:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:3.0:1789297341.785502:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38690380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+52:11535:x1876213933091456:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 419us (581us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297341.785994:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 169 00000100:00100000:0.0:1789297341.810929:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297341.811039:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933091584 00000100:00100000:1.0:1789297341.811050:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933091584 00000100:00100000:1.0:1789297341.811099:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 170 00000100:00100000:1.0:1789297341.811109:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+52:11537:x1876213933091584:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297341.811131:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297341.811150:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bfc6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57db99 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811216:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811231:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811242:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811253:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811258:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811262:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811486:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811505:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811510:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297341.811546:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:1.0:1789297341.811550:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297341.811569:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811581:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811589:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811594:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811601:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811607:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297341.811612:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811620:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811632:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297341.811634:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297341.811646:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811652:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0bfcd lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811665:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811671:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811677:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811683:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297341.811686:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811691:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811697:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b08585400) 00010000:00010000:1.0:1789297341.811698:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297341.811700:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811837:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0bfd4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811869:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0bfc6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 54 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811901:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 53 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297341.811908:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297341.811910:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789297341.811913:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2400, rc 0) 00000100:00100000:1.0:1789297341.811985:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38690700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+53:11537:x1876213933091584:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 876us (1065us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297341.811993:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 170 00010000:00010000:3.0:1789297341.949476:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297342.012897:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789297342.012904:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789297342.013114:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1789297342.013121:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789297342.013242:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3fbb7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957208064:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789297342.013340:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7240 going to sleep for 11 seconds 00000100:00100000:1.0:1789297342.029411:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3fbb7b80 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957208064:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789297342.029439:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.029607:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933091712 00000100:00100000:3.0:1789297342.029615:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933091712 00000100:00100000:3.0:1789297342.029680:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 171 00000100:00100000:3.0:1789297342.029691:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+53:11548:x1876213933091712:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789297342.029753:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789297342.029884:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+53:11548:x1876213933091712:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 195us (447us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297342.029892:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 171 00000100:00100000:0.0:1789297342.035444:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.035594:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933091840 00000100:00100000:3.0:1789297342.035606:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933091840 00000100:00100000:3.0:1789297342.035676:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 172 00000100:00100000:3.0:1789297342.035688:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+53:11548:x1876213933091840:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1789297342.035818:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.035837:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.035852:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.035924:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.035933:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.035957:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.035987:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.035995:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036002:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297342.036041:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1789297342.036046:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297342.036060:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036072:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036078:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036084:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036091:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297342.036095:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036103:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036123:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:3.0:1789297342.036126:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297342.036131:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036138:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0bfe2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036152:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036159:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036163:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036169:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297342.036171:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036177:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036184:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff982b03073a00) 00010000:00010000:3.0:1789297342.036186:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297342.036189:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036195:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0bfe9 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036225:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036232:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036238:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036243:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297342.036246:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036252:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036260:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297342.036262:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297342.036265:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.036271:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0bff0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.036496:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38692300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+53:11548:x1876213933091840:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 810us (1061us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297342.036505:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 172 00000100:00100000:2.0:1789297342.058909:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297342.058997:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933092096 00000100:00100000:0.0:1789297342.059010:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933092096 00000100:00100000:0.0:1789297342.059076:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 173 00000100:00100000:0.0:1789297342.059088:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+53:11548:x1876213933092096:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297342.059112:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297342.059135:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0bff7 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dba0 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059243:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059258:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059271:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297342.059282:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:0.0:1789297342.059468:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059477:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059483:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059489:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297342.059493:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059501:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059512:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:0.0:1789297342.059515:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789297342.059520:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059526:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0bffe lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059571:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0bff7 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dba0 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059581:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:0.0:1789297342.059583:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297342.059587:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0bff7 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dba0 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.059609:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bbc00, rc 0) 00000100:00100000:0.0:1789297342.059668:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+54:11548:x1876213933092096:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 583us (770us total) trans 4294967458 rc 301/301 00000100:00100000:0.0:1789297342.059676:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 173 00000100:00100000:0.0:1789297342.067182:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.067363:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933092224 00000100:00100000:1.0:1789297342.067374:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933092224 00000100:00100000:1.0:1789297342.067442:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 174 00000100:00100000:1.0:1789297342.067452:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+54:11548:x1876213933092224:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789297342.067488:0:7920:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789297342.067778:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38691880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+54:11548:x1876213933092224:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 326us (607us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297342.067787:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 174 00000100:00100000:0.0:1789297342.071868:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.071932:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933092480 00000100:00100000:2.0:1789297342.071944:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933092480 00000100:00100000:2.0:1789297342.072010:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 175 00000100:00100000:2.0:1789297342.072021:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+54:11548:x1876213933092480:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297342.072044:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297342.072048:0:5843:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1789297342.072079:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0bfb8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db92 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.072120:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297342.072126:0:5843:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789297342.072142:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c00c lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dba7 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1789297342.072838:0:5843:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:2.0:1789297342.073061:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0c013 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.073076:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0c013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.073087:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0c013 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.073145:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c00c lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dba7 expref: 56 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.073164:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0c013 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dba7 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.073172:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:2.0:1789297342.073174:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297342.073177:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257400, rc 0) 00000100:00100000:2.0:1789297342.073251:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38693480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+55:11548:x1876213933092480:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1232us (1396us total) trans 4294967459 rc 0/0 00000100:00100000:2.0:1789297342.073260:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 175 00000100:00100000:2.0:1789297342.080580:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297342.080644:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933092736 00000100:00100000:0.0:1789297342.080656:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933092736 00000100:00100000:0.0:1789297342.080759:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 176 00000100:00100000:0.0:1789297342.080772:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+55:11548:x1876213933092736:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789297342.080843:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297342.080873:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257400/0x8ad177e823a0c013 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dba7 expref: 55 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.080905:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85900) 00010000:00010000:0.0:1789297342.080916:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297342.080940:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.080954:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.080964:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.080979:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081005:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081012:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081240:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081249:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081256:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081262:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bae00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297342.081267:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081274:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081283:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:0.0:1789297342.081286:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297342.081289:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081296:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c021 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081306:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081317:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081324:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081328:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297342.081331:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081337:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081344:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0xf5ad979a (ffff982b15d3a500) 00010000:00010000:0.0:1789297342.081346:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297342.081348:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.081354:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c028 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0xf5ad979a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.081443:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+54:11548:x1876213933092736:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 672us (875us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789297342.081450:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 176 00000100:00100000:0.0:1789297342.083640:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.083754:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933092864 00000100:00100000:2.0:1789297342.083764:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933092864 00000100:00100000:2.0:1789297342.083820:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 177 00000100:00100000:2.0:1789297342.083830:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+54:11548:x1876213933092864:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297342.083849:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297342.083869:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c02f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbae expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.083912:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.083926:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.083938:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.084032:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c02f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 56 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.084049:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.084057:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:2.0:1789297342.084060:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789297342.084063:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257e00, rc 0) 00000100:00100000:2.0:1789297342.084130:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38690a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+55:11548:x1876213933092864:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 301us (502us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.084146:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 177 00000100:00100000:2.0:1789297342.087737:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.087851:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933093120 00000100:00100000:1.0:1789297342.087864:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933093120 00000100:00100000:1.0:1789297342.087938:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 178 00000100:00100000:1.0:1789297342.087949:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+55:11548:x1876213933093120:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789297342.088051:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.088069:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.088081:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789297342.088374:0:7920:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:1.0:1789297342.088384:0:7920:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 353962679843ns, next at 354962677271ns, rc = 0 00000004:00010000:1.0:1789297342.088495:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000055aa21d9 reply state 00000000b3cf13ad transno 4294967460 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.088506:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789297342.088632:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+57:11548:x1876213933093120:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 683us (926us total) trans 4294967460 rc 0/0 00000100:00100000:1.0:1789297342.088640:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 178 00000100:00100000:1.0:1789297342.098861:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00010000:00010000:1.0:1789297342.098900:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.098914:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.098922:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.098940:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.098945:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.098955:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.098976:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:1.0:1789297342.098980:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789297342.098986:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.098993:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c03d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.099029:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933093248 00000100:00100000:1.0:1789297342.099039:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933093248 00000100:00100000:1.0:1789297342.099092:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 179 00000100:00100000:1.0:1789297342.099102:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+56:11548:x1876213933093248:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297342.099129:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297342.099147:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbb5 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.099256:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.099274:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 57 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.099312:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:1.0:1789297342.099315:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789297342.099318:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3200, rc 0) 00000100:00100000:1.0:1789297342.099379:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+57:11548:x1876213933093248:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 278us (528us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297342.099401:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 179 00000100:00100000:3.0:1789297342.105501:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.105615:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933093376 00000100:00100000:1.0:1789297342.105628:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933093376 00000100:00100000:1.0:1789297342.105743:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:1.0:1789297342.105755:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+6:2354:x1876213933093376:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00100000:1.0:1789297342.106149:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933093376:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 396us (662us total) trans 4294967313 rc 0/0 00000100:00100000:1.0:1789297342.106158:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00080000:3.0:1789297342.106733:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297342.108428:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.108528:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933093632 00000100:00100000:3.0:1789297342.108556:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933093632 00000100:00100000:3.0:1789297342.108627:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:3.0:1789297342.108641:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+57:11548:x1876213933093632:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1789297342.108944:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+58:11548:x1876213933093632:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 307us (526us total) trans 4294967461 rc 0/0 00000100:00100000:3.0:1789297342.108953:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:1.0:1789297342.118634:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.118740:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933093888 00000100:00100000:2.0:1789297342.118752:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933093888 00000100:00100000:2.0:1789297342.118827:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 180 00000100:00100000:2.0:1789297342.118837:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+58:11548:x1876213933093888:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789297342.118957:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+58:11548:x1876213933093888:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 120us (335us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.118965:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 180 00000100:00100000:3.0:1789297342.133036:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.133339:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933094016 00000100:00100000:1.0:1789297342.133352:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933094016 00000100:00100000:1.0:1789297342.133428:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:1.0:1789297342.133440:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+58:11548:x1876213933094016:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297342.133463:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297342.133485:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c04b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbbc expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.133582:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c052 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.133603:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.133618:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297342.133657:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297342.133676:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c052 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.133896:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c04b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbbc expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.133917:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c052 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbbc expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.133927:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:1.0:1789297342.133930:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789297342.133934:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2600, rc 0) 00000100:00100000:1.0:1789297342.133993:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+59:11548:x1876213933094016:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 555us (968us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297342.134002:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 181 00000100:00100000:1.0:1789297342.154454:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.154691:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933094144 00000100:00100000:2.0:1789297342.154736:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933094144 00000100:00100000:2.0:1789297342.154800:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:2.0:1789297342.154813:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933094144:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297342.154833:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297342.154857:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbc3 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297342.154887:0:11700:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa682be, blocks: 0x1 00010000:00010000:2.0:1789297342.154910:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1789297342.154914:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297342.154924:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 8 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.154946:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 8 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.154978:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256e00, rc 0) 00000100:00100000:2.0:1789297342.155042:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933094144:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 232us (598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.155049:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:1.0:1789297342.166036:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.166121:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933094400 00000100:00100000:3.0:1789297342.166133:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933094400 00000100:00100000:3.0:1789297342.166205:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00100000:3.0:1789297342.166216:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+59:11548:x1876213933094400:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:3.0:1789297342.166334:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+59:11548:x1876213933094400:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 120us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297342.166342:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 182 00000100:00100000:3.0:1789297342.170323:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297342.170423:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933094528 00000100:00100000:0.0:1789297342.170434:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933094528 00000100:00100000:0.0:1789297342.170502:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:0.0:1789297342.170513:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:11548:x1876213933094528:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297342.170558:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297342.170578:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbca expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.170613:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 9 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.170623:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297342.170627:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297342.170632:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.170669:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 9 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.170683:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 9 pid: 11700 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.170699:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876213957208192:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297342.170851:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3180 going to sleep for 11 seconds 00000100:00100000:0.0:1789297342.178317:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38690000 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6688:1876213957208192:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297342.178358:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 9 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.178383:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba600, rc 0) 00000100:00100000:0.0:1789297342.178482:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+9:11548:x1876213933094528:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 7970us (8172us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297342.178491:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:2.0:1789297342.190879:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.191014:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933094656 00000100:00100000:3.0:1789297342.191025:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933094656 00010000:00010000:3.0:1789297342.191082:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 9 pid: 11700 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.191172:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:3.0:1789297342.191185:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+9:2354:x1876213933094656:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297342.191203:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297342.191229:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 9 pid: 11700 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.191258:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 9 pid: 11700 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.191285:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c059 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbc3 expref: 9 pid: 11700 timeout: 454 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.191304:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297342.191309:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297342.191319:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.191328:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.191375:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.191408:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1876213957208320:192.168.202.43@tcp:105: 00000100:00100000:3.0:1789297342.191501:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b219b9cc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297342.194349:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1876213957208320:192.168.202.43@tcp:105: 00010000:00010000:3.0:1789297342.194387:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297342.194583:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933094656:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 3400us (3712us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297342.194596:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:0.0:1789297342.204249:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.204494:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933094784 00000100:00100000:3.0:1789297342.204504:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933094784 00002000:00100000:3.0:1789297342.204564:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff982b38690000 x1876213933094784/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:203/0 lens 504/0 e 0 to 0 dl 1789297353 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297342.204576:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b38690000 with x1876213933094784 ext(0->8) 00002000:00010000:3.0:1789297342.204582:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b38690000 00000100:00100000:3.0:1789297342.204620:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:3.0:1789297342.204632:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933094784:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:3.0:1789297342.206060:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+10:2354:x1876213933094784:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 1424us (1811us total) trans 4294967314 rc 0/0 00000100:00100000:3.0:1789297342.206072:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00002000:00100000:3.0:1789297342.206082:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff982b38690000 x1876213933094784/t4294967314(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:203/0 lens 504/448 e 0 to 0 dl 1789297353 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297342.206092:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b38690000 with x1876213933094784 ext(0->8) 00002000:00010000:3.0:1789297342.206098:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b38690000 00000100:00100000:0.0:1789297342.210318:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.210425:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933094912 00000100:00100000:2.0:1789297342.210437:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933094912 00000100:00100000:2.0:1789297342.210505:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 183 00000100:00100000:2.0:1789297342.210527:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+59:11548:x1876213933094912:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:0.0:1789297342.245848:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967458 is committed 00000001:00080000:0.0:1789297342.245873:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:0.0:1789297342.245878:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000004:00080000:0.0:1789297342.245906:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000004:00080000:0.0:1789297342.245934:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:0.0:1789297342.245943:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b051d7b40 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:0.0:1789297342.245949:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b03ebe500 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b051d7600 00000020:00080000:0.0:1789297342.245952:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b03ebec00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982b40518400 00000001:00080000:0.0:1789297342.245971:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967461 is committed 00000100:00100000:1.0:1789297342.246173:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000020:00080000:3.0:1789297342.246221:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:3.0:1789297342.246837:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:2.0:1789297342.246837:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38691180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+18:11548:x1876213933094912:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 36307us (36525us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.246849:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 183 00000100:00100000:1.0:1789297342.246986:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957208448:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1789297342.247053:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297342.247303:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957208448 00000100:00100000:1.0:1789297342.247326:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957208448 00000100:00100000:1.0:1789297342.247394:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789297342.247403:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957208448:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1789297342.247568:0:11700:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1789297342.247572:0:11700:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789297342 00002000:00010000:1.0:1789297342.247575:0:11700:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1789297342.247576:0:11700:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789297342 -> 1789297342 00002000:00010000:1.0:1789297342.247579:0:11700:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1789297342.247619:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957208448:12345-0@lo:2:osp-syn-1-0.0 Request processed in 218us (566us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1789297342.247626:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1789297342.247860:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297342.247870:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957208576:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1789297342.247981:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297342.248012:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957208576 00000100:00100000:2.0:1789297342.248016:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957208576 00000100:00100000:2.0:1789297342.248046:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1789297342.248053:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3304:x1876213957208576:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:2.0:1789297342.248074:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:2.0:1789297342.248176:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6aa682bc, atime: 0x6aa682bc, ctime: 0x6aa682bc, blocks: 0x1 00010000:00010000:2.0:1789297342.248185:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.248218:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1789297342.248222:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297342.248230:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.248249:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.248259:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.248268:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.248287:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00080000:0.0:1789297342.248635:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1789297342.248640:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000004:00080000:1.0:1789297342.249178:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b41ee4380/2, rc 0, transno 4294967315 00000100:00100000:1.0:1789297342.249189:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957208448:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789297342.250366:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3304:x1876213957208576:12345-0@lo:6:osp-syn-0-0.0 Request processed in 2306us (2377us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1789297342.250378:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00010000:2.0:1789297342.250415:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297342.250423:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.250435:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297342.250439:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.250465:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.250485:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.250492:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000efcc4652/0x8ad177e823a0c067 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.250510:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297342.250512:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297342.250514:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1789297342.251023:0:3304:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b27af4380/2, rc 0, transno 4294967307 00000100:00100000:1.0:1789297342.251032:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957208576:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789297342.253685:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.254819:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933095040 00000100:00100000:1.0:1789297342.254834:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933095040 00000100:00100000:1.0:1789297342.254911:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:1.0:1789297342.254923:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+10:2353:x1876213933095040:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789297342.316245:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38692a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+10:2353:x1876213933095040:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 61314us (62566us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.316259:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000001:00080000:3.0:1789297342.316309:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000001:00080000:3.0:1789297342.316320:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967313 is committed 00000001:00080000:3.0:1789297342.316324:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000100:00100000:0.0:1789297342.330989:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.331679:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933095296 00000100:00100000:3.0:1789297342.331692:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933095296 00000100:00100000:3.0:1789297342.331983:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 184 00000100:00100000:3.0:1789297342.331996:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+18:11548:x1876213933095296:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789297342.332054:0:7920:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297342.332087:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c052 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbbc expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.332105:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:3.0:1789297342.332110:0:7920:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297342.332142:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.332155:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.332167:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297342.332405:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006d6cd0ec reply state 000000007a5f831b transno 4294967462 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.332415:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297342.332514:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38692680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+19:11548:x1876213933095296:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 521us (1532us total) trans 4294967462 rc 0/0 00000100:00100000:3.0:1789297342.332522:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 184 00010000:00010000:0.0:1789297342.337186:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.337205:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.337213:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.337219:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297342.337224:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.337240:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.337257:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:0.0:1789297342.337260:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297342.337264:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.337270:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c06e lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.341338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.341424:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933095424 00000100:00100000:2.0:1789297342.341434:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933095424 00000100:00100000:2.0:1789297342.341487:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:2.0:1789297342.341496:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933095424:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1789297342.341760:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:2.0:1789297342.341763:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789297342 -> 1789297341 00002000:00010000:2.0:1789297342.341766:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789297340 00002000:00010000:2.0:1789297342.341768:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789297342 -> 1789297341 00002000:00010000:2.0:1789297342.341770:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1789297342.341840:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38693100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933095424:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 343us (511us total) trans 4294967316 rc 0/0 00000100:00100000:2.0:1789297342.341856:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:0.0:1789297342.346869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.346973:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933095680 00000100:00100000:3.0:1789297342.346984:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933095680 00000100:00100000:3.0:1789297342.347058:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 185 00000100:00100000:3.0:1789297342.347071:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+18:11548:x1876213933095680:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:3.0:1789297342.347151:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.347170:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.347198:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.347235:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.347249:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 18 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.347264:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957208704:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297342.347357:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b219b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297342.350655:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957208704:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297342.350694:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.353429:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.353545:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933095808 00000100:00100000:2.0:1789297342.353555:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933095808 00010000:00010000:2.0:1789297342.353596:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297342.353752:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:2.0:1789297342.353764:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+19:2354:x1876213933095808:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297342.353781:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297342.353801:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.353814:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.353838:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c036 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbae expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.353853:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:2.0:1789297342.353858:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.353867:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.353874:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.353919:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297342.353971:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+18:2354:x1876213933095808:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 209us (551us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.353979:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 71 00010000:00010000:1.0:1789297342.354037:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354045:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354073:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354090:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354096:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354102:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.354106:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354112:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354122:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:1.0:1789297342.354125:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:1.0:1789297342.354128:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.354133:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c075 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.354173:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38692d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+17:11548:x1876213933095680:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 7106us (7316us total) trans 0 rc -22/-22 00000100:00100000:1.0:1789297342.354181:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 185 00000100:00100000:1.0:1789297342.357172:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297342.357344:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933095936 00000100:00100000:0.0:1789297342.357356:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933095936 00000100:00100000:0.0:1789297342.357452:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:0.0:1789297342.357465:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933095936:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789297342.357514:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.357538:0:6689:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.357547:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297342.357552:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1789297342.357556:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.357619:0:6689:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 8 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.357634:0:6689:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 8 pid: 6688 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.357651:0:6689:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957208832:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297342.357777:0:6689:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c53a80 going to sleep for 11 seconds 00000100:00100000:1.0:1789297342.359568:0:6689:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6689:1876213957208832:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297342.359597:0:6689:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.360407:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.360641:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933096064 00000100:00100000:2.0:1789297342.360652:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933096064 00010000:00010000:2.0:1789297342.360696:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 9 pid: 6688 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297342.360972:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:2.0:1789297342.360984:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+9:2354:x1876213933096064:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297342.361004:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297342.361031:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 9 pid: 6688 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.361044:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 9 pid: 6688 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.361068:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009481c315/0x8ad177e823a0c060 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbca expref: 9 pid: 6688 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.361084:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297342.361088:0:7633:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297342.361094:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.361123:0:7633:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.361157:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297342.361221:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933096064:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 239us (816us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.361230:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 72 00010000:00010000:1.0:1789297342.361501:0:6689:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361510:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361538:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361547:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361555:0:6689:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361562:0:6689:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297342.361566:0:6689:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361575:0:6689:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361588:0:6689:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.361608:0:6689:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000e5d06886/0x8ad177e823a0c07c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.361673:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933095936:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 4209us (4519us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297342.361680:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:1.0:1789297342.367362:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.367582:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933096320 00000100:00100000:3.0:1789297342.367592:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933096320 00000100:00100000:3.0:1789297342.367664:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 186 00000100:00100000:3.0:1789297342.367677:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+17:11548:x1876213933096320:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1789297342.367806:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.367825:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.367837:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.368062:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.368074:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.368083:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.368119:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 18 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.368133:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 18 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.368147:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957208960:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297342.368231:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b219b9c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297342.370605:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957208960:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297342.370642:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.373619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.373695:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933096448 00000100:00100000:3.0:1789297342.373835:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933096448 00010000:00010000:0.0:1789297342.373935:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.373975:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:0.0:1789297342.373985:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+19:2354:x1876213933096448:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297342.374001:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297342.374008:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.374041:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.374065:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c044 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbb5 expref: 19 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.374081:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:0.0:1789297342.374099:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.374109:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.374116:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.374145:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297342.374199:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+18:2354:x1876213933096448:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 215us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297342.374206:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00010000:00010000:3.0:1789297342.374416:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.374424:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297342.374627:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:3.0:1789297342.374912:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000001:00080000:3.0:1789297342.374968:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:3.0:1789297342.375052:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876213957209088:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789297342.375109:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297342.375243:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297342.376053:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957209088 00000100:00100000:0.0:1789297342.376063:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957209088 00000100:00100000:0.0:1789297342.376170:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789297342.376182:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876213957209088:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1789297342.376293:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5842:x1876213957209088:12345-0@lo:1000:mdt00_000.0 Request processed in 112us (1182us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297342.376300:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789297342.376357:0:5842:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:3.0:1789297342.376363:0:5842:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b41ee4380, transno 4294967315 00000100:00100000:3.0:1789297342.376384:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876213957209088:0@lo:1000:mdt00_000.0 00000001:00080000:3.0:1789297342.376895:0:5842:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967466 00000100:00100000:3.0:1789297342.376970:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876213957209216:0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1789297342.377007:0:5842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297342.377689:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957209216 00000100:00100000:1.0:1789297342.377697:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957209216 00000100:00100000:1.0:1789297342.377763:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297342.377771:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:5842:x1876213957209216:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1789297342.377970:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5842:x1876213957209216:12345-0@lo:1000:mdt00_000.0 Request processed in 199us (962us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1789297342.377978:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789297342.378044:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b219b9cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297342.378068:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca3480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5842:1876213957209216:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1789297342.378103:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378113:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378121:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378128:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297342.378133:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378140:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378156:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b2ac85500) 00010000:00010000:2.0:1789297342.378159:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789297342.378163:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378181:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c08a lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378212:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378218:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378224:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378228:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148ea00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297342.378231:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378236:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378244:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:2.0:1789297342.378246:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789297342.378248:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378253:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0bfbf lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378275:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378288:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 21 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378303:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378329:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 21 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.378343:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 21 pid: 7920 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297342.378355:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957209344:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297342.378440:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789297342.381391:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.381844:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af5880 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957209344:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297342.381871:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.382042:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933096576 00000100:00100000:3.0:1789297342.382050:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933096576 00010000:00010000:3.0:1789297342.382094:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 22 pid: 7920 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.382174:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:3.0:1789297342.382185:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+22:2353:x1876213933096576:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297342.382202:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297342.382209:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 22 pid: 7920 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.382222:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 22 pid: 7920 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.382262:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0bfdb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57db99 expref: 22 pid: 7920 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.382278:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:3.0:1789297342.382283:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.382293:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.382301:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.382332:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297342.382399:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:2353:x1876213933096576:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 217us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297342.382407:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00010000:00010000:1.0:1789297342.383158:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383170:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383182:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383188:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383208:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383215:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.383219:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383227:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383239:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297342.383242:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297342.383245:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383252:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c091 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383265:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383272:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383278:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383283:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.383285:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383300:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383309:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073900) 00010000:00010000:1.0:1789297342.383311:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789297342.383313:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.383319:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c083 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.383569:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+20:11548:x1876213933096320:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 15893us (16216us total) trans 4294967467 rc 0/0 00000100:00100000:1.0:1789297342.383579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 186 00000020:00080000:1.0:1789297342.383583:0:5842:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1789297342.384005:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789297342.384010:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789297342.384766:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1789297342.384778:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789297342.388563:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.388628:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933096832 00000100:00100000:3.0:1789297342.388639:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933096832 00000100:00100000:3.0:1789297342.388734:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:3.0:1789297342.388748:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13010850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+20:11548:x1876213933096832:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:3.0:1789297342.389427:0:5846:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:3.0:1789297342.389538:0:5846:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967468 00010000:00010000:3.0:1789297342.389584:0:5846:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.389600:0:5846:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.389623:0:5846:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.389633:0:5846:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.389640:0:5846:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.389646:0:5846:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.389661:0:5846:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789297342.389801:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13010850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+22:11548:x1876213933096832:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 1054us (1245us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1789297342.389809:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000020:00080000:3.0:1789297342.389813:0:5846:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789297342.390023:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297342.390031:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.390039:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297342.390043:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.390052:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.390066:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff982b03073100) 00010000:00010000:2.0:1789297342.390075:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789297342.390079:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.390086:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c098 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5846 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.390108:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297342.390109:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297342.390111:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789297342.486537:0:12522:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297342.486548:0:12522:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297342.486589:0:12522:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:2.0:1789297342.486594:0:12522:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789297342.631085:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.631218:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933097088 00000100:00100000:3.0:1789297342.631230:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933097088 00000100:00100000:3.0:1789297342.631302:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:3.0:1789297342.631319:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+22:11558:x1876213933097088:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297342.631348:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297342.631369:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c09f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbd1 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.631484:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c0a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.631501:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.631652:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c0a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297342.631665:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00010000:00010000:3.0:1789297342.631824:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c09f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd1 expref: 25 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.631941:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c0a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd1 expref: 24 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.631952:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297342.631955:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789297342.631958:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e200, rc 0) 00000100:00100000:3.0:1789297342.632056:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+24:11558:x1876213933097088:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 744us (991us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1789297342.632064:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 187 00000100:00100000:1.0:1789297342.644137:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.644243:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933097216 00000100:00100000:3.0:1789297342.644254:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933097216 00000100:00100000:3.0:1789297342.644354:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:3.0:1789297342.644367:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+24:11558:x1876213933097216:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:3.0:1789297342.644587:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.644605:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.644618:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.644645:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.644653:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.644767:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645027:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645036:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645044:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297342.645203:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645217:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645224:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645231:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645238:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148ea00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297342.645242:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645262:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645274:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297342.645277:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297342.645281:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645288:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c0b4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645298:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645304:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645310:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645315:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297342.645318:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645323:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645330:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b03073a00) 00010000:00010000:3.0:1789297342.645332:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297342.645335:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645349:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645367:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645373:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645379:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645471:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297342.645475:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645482:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645491:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b03073000) 00010000:00010000:3.0:1789297342.645493:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297342.645496:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.645502:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.645717:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+24:11558:x1876213933097216:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 1335us (1634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297342.645727:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 188 00000100:00100000:1.0:1789297342.712801:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.712854:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933097472 00000100:00100000:1.0:1789297342.712865:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933097472 00000100:00100000:1.0:1789297342.712926:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:1.0:1789297342.712937:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+24:11561:x1876213933097472:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297342.712960:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297342.712981:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c0c9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbd8 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.713059:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.713086:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.713100:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.713115:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.713121:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.713128:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717017:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717040:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717053:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297342.717066:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1789297342.717172:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717181:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717189:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717204:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.717208:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717216:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717230:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297342.717233:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297342.717237:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717243:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c0d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717255:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717261:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717267:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717272:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.717275:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717281:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717301:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b08585900) 00010000:00010000:1.0:1789297342.717304:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297342.717307:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717313:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c0d7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717367:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c0c9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717811:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.717823:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:1.0:1789297342.717826:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297342.717829:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2000, rc 0) 00000100:00100000:1.0:1789297342.720867:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+26:11561:x1876213933097472:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 7914us (8066us total) trans 4294967471 rc 0/0 00000100:00100000:1.0:1789297342.720883:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 189 00000100:00100000:3.0:1789297342.726301:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.727500:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933097600 00000100:00100000:2.0:1789297342.727513:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933097600 00000100:00100000:2.0:1789297342.727578:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:2.0:1789297342.727590:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+26:11561:x1876213933097600:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:2.0:1789297342.727673:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727690:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727720:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727750:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727758:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727775:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727780:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297342.727796:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727804:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727815:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:2.0:1789297342.727818:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789297342.727824:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.727829:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c0ec lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297342.727910:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+26:11561:x1876213933097600:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 322us (1619us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.727918:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 190 00000100:00100000:3.0:1789297342.738902:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297342.740102:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933097856 00000100:00100000:0.0:1789297342.740115:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933097856 00000100:00100000:0.0:1789297342.740181:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:0.0:1789297342.740193:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+26:11561:x1876213933097856:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:0.0:1789297342.740452:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+27:11561:x1876213933097856:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 261us (1557us total) trans 4294967472 rc 0/0 00000100:00100000:0.0:1789297342.740475:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:1.0:1789297342.777139:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.777201:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933098112 00000100:00100000:3.0:1789297342.777212:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933098112 00000100:00100000:3.0:1789297342.777292:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:3.0:1789297342.777304:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+27:11094:x1876213933098112:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789297342.777336:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297342.777358:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbdf expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.777490:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.777515:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.777525:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.777567:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 28 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.777583:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 28 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.777597:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957209472:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297342.777744:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1789297342.789262:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957209472:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297342.789322:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.791571:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297342.791668:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933098240 00000100:00100000:0.0:1789297342.791678:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933098240 00010000:00010000:0.0:1789297342.791760:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.791810:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:0.0:1789297342.791820:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+29:2353:x1876213933098240:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297342.791840:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297342.791847:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.791872:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.791897:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c0de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd8 expref: 29 pid: 5844 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.791914:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:0.0:1789297342.791919:0:5827:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.791929:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.791950:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.791981:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297342.792038:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+28:2353:x1876213933098240:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 219us (476us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297342.792046:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00010000:00010000:3.0:1789297342.792544:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.792563:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297342.792584:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1789297342.792815:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c0f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 29 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.792836:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 28 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.792844:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:3.0:1789297342.792847:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789297342.792850:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fa00, rc 0) 00000100:00100000:3.0:1789297342.792905:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+28:11094:x1876213933098112:12345-192.168.202.43@tcp:101:bash.0 Request processed in 15604us (15775us total) trans 4294967473 rc 0/0 00000100:00100000:3.0:1789297342.792914:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 191 00000100:00100000:3.0:1789297342.797445:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.798043:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933098496 00000100:00100000:1.0:1789297342.798059:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933098496 00000100:00100000:1.0:1789297342.798158:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 192 00000100:00100000:1.0:1789297342.798169:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+28:11094:x1876213933098496:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:1.0:1789297342.798493:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.798538:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.798550:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789297342.798895:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000004:00010000:1.0:1789297342.798928:0:7920:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000043aeea6c reply state 0000000072061077 transno 4294967475 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297342.798937:0:7920:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1789297342.798992:0:7920:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967475 00000100:00100000:1.0:1789297342.799157:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+32:11094:x1876213933098496:12345-192.168.202.43@tcp:36:bash.0 Request processed in 986us (1718us total) trans 4294967476 rc 0/0 00000100:00100000:1.0:1789297342.799165:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 192 00000020:00080000:1.0:1789297342.799171:0:7920:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:2.0:1789297342.802750:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.802770:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.802778:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.802794:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297342.802816:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.802825:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.802843:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:2.0:1789297342.802846:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297342.802850:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.802857:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c108 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.804658:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297342.804739:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933098624 00000100:00100000:0.0:1789297342.804751:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933098624 00000100:00100000:0.0:1789297342.804821:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:0.0:1789297342.804833:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+31:11094:x1876213933098624:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297342.804869:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297342.804890:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c10f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbe6 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.804955:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c10f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbe6 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.804971:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c10f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbe6 expref: 32 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.804991:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:0.0:1789297342.804994:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297342.804998:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bba00, rc 0) 00000100:00100000:0.0:1789297342.805064:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+32:11094:x1876213933098624:12345-192.168.202.43@tcp:101:bash.0 Request processed in 234us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297342.805071:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 193 00000100:00100000:0.0:1789297342.808484:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.808592:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933098752 00000100:00100000:2.0:1789297342.808602:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933098752 00000100:00100000:2.0:1789297342.808667:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:2.0:1789297342.808677:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:11094:x1876213933098752:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:2.0:1789297342.808696:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297342.808743:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbed expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297342.808771:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa682bd, atime: 0x6aa682bc, ctime: 0x6aa682bd, blocks: 0xb 00010000:00010000:2.0:1789297342.808804:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:2.0:1789297342.808809:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297342.808817:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.808834:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 8 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.808864:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257400, rc 0) 00000100:00100000:2.0:1789297342.808924:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:11094:x1876213933098752:12345-192.168.202.43@tcp:101:bash.0 Request processed in 249us (451us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.808931:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:1.0:1789297342.811668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.811927:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933098880 00000100:00100000:3.0:1789297342.811939:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933098880 00002000:00010000:3.0:1789297342.811999:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789297342.812005:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b0259ce00 with x1876213933098880 ext(0->18446744073709551615) 00002000:00010000:3.0:1789297342.812018:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b0259ce00. 00000100:00100000:3.0:1789297342.812052:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789297342.812064:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2355:x1876213933098880:12345-192.168.202.43@tcp:10:bash.0 00002000:00010000:3.0:1789297342.812613:0:6693:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:3.0:1789297342.812633:0:6693:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1789297341 -> 1789297343 00002000:00010000:3.0:1789297342.812636:0:6693:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1789297340 -> 1789297340 00002000:00010000:3.0:1789297342.812638:0:6693:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1789297341 -> 1789297343 00002000:00010000:3.0:1789297342.812641:0:6693:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:3.0:1789297342.812911:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:235dd3df-f928-4719-bb69-fc817cc2744f+9:2355:x1876213933098880:12345-192.168.202.43@tcp:10:bash.0 Request processed in 846us (1251us total) trans 4294967318 rc 0/0 00000100:00100000:3.0:1789297342.812921:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00002000:00010000:3.0:1789297342.812925:0:6693:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:3.0:1789297342.812928:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b0259ce00 with x1876213933098880 ext(0->18446744073709551615) 00002000:00010000:3.0:1789297342.812934:0:6693:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b0259ce00. 00000100:00100000:3.0:1789297342.896112:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.896286:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933099008 00000100:00100000:2.0:1789297342.896298:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933099008 00000100:00100000:2.0:1789297342.896364:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00100000:2.0:1789297342.896375:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+32:11575:x1876213933099008:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789297342.896464:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.896484:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.896496:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.896752:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.896761:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.896768:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897020:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897042:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897050:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297342.897095:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897107:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897114:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897121:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897127:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297342.897131:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897139:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897302:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297342.897307:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297342.897312:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897319:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c11d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897342:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897348:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897354:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897360:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297342.897363:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897369:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897377:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b2ac85900) 00010000:00010000:2.0:1789297342.897380:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297342.897383:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897388:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c124 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897474:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897480:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897485:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897497:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297342.897501:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897578:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897587:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:2.0:1789297342.897589:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297342.897592:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.897597:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c12b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297342.897698:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+32:11575:x1876213933099008:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 1320us (1591us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.897758:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 194 00000100:00100000:0.0:1789297342.933286:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.933417:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933099264 00000100:00100000:1.0:1789297342.933428:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933099264 00000100:00100000:1.0:1789297342.933493:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 195 00000100:00100000:1.0:1789297342.933512:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+32:11578:x1876213933099264:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297342.933535:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297342.933560:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c132 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbf4 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.933633:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.933649:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.933676:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.933692:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.933699:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.933731:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934012:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c147 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934021:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934028:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c147 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297342.934037:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:1.0:1789297342.934131:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934140:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934146:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934152:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.934162:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934170:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934183:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297342.934186:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297342.934190:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934196:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c139 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934209:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934215:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934221:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934226:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297342.934229:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934235:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934242:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b08585900) 00010000:00010000:1.0:1789297342.934244:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297342.934253:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934259:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c140 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934300:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c132 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbf4 expref: 35 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934314:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c147 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbf4 expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297342.934322:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:1.0:1789297342.934325:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:1.0:1789297342.934327:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2600, rc 0) 00000100:00100000:1.0:1789297342.934401:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+34:11578:x1876213933099264:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 899us (1128us total) trans 4294967477 rc 0/0 00000100:00100000:1.0:1789297342.934409:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 195 00000100:00100000:1.0:1789297342.938300:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.938404:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933099392 00000100:00100000:3.0:1789297342.938415:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933099392 00000100:00100000:3.0:1789297342.938488:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 196 00000100:00100000:3.0:1789297342.938500:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+34:11578:x1876213933099392:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:3.0:1789297342.938585:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.938604:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.938613:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.938651:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 34 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297342.938665:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 34 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.938696:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39c86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957209600:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297342.938850:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b39ad5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1789297342.942417:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.942822:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933099648 00000100:00100000:3.0:1789297342.942832:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933099648 00000100:00100000:3.0:1789297342.942898:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:3.0:1789297342.942910:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+35:5595:x1876213933099648:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1789297342.943284:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+36:5595:x1876213933099648:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 376us (876us total) trans 4294967478 rc 0/0 00000100:00100000:3.0:1789297342.943292:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:0.0:1789297342.943433:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39c86300 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957209600:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297342.943460:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297342.946403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.946582:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933099776 00000100:00100000:2.0:1789297342.946593:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933099776 00010000:00010000:2.0:1789297342.946634:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 36 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297342.946679:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:2.0:1789297342.946689:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02e82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+36:2353:x1876213933099776:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297342.946734:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297342.946742:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 36 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.946777:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 36 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.946812:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c0fa lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbdf expref: 36 pid: 5843 timeout: 454 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.946831:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:2.0:1789297342.946836:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.946846:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.946853:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297342.946873:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297342.946985:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02e82050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+35:2353:x1876213933099776:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 297us (590us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.946993:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 76 00010000:00010000:0.0:1789297342.947094:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947103:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947136:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947144:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947150:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947169:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148ea00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297342.947175:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947182:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947192:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:0.0:1789297342.947195:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297342.947199:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297342.947218:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c155 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297342.947265:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+34:11578:x1876213933099392:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 8767us (8975us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297342.947272:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 196 00000100:00100000:2.0:1789297342.950067:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297342.950233:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933100032 00000100:00100000:3.0:1789297342.950245:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933100032 00000100:00100000:3.0:1789297342.950358:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:3.0:1789297342.950372:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+34:11578:x1876213933100032:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297342.950660:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+35:11578:x1876213933100032:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 292us (605us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1789297342.950668:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:1.0:1789297342.958792:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.958833:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297342.958865:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297342.958956:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933100160 00000100:00100000:2.0:1789297342.958966:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933100160 00000100:00100000:2.0:1789297342.959009:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 294 00000100:00100000:2.0:1789297342.959018:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933100160:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297342.959092:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933100160:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 73us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.959118:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 294 00000100:00100000:0.0:1789297342.959483:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933100288 00000100:00100000:0.0:1789297342.959488:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933100288 00000100:00100000:0.0:1789297342.959549:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:0.0:1789297342.959557:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933100288:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297342.959600:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933100288:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 45us (735us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297342.959606:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00080000:2.0:1789297342.959769:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297342.960087:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933100416 00000100:00100000:3.0:1789297342.960093:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933100416 00000100:00080000:2.0:1789297342.960183:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297342.960689:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 151 00000100:00100000:2.0:1789297342.960735:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933100416:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297342.960801:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2355:x1876213933100416:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 103us (1967us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297342.960808:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 151 00010000:00010000:3.0:1789297342.973119:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297343.034192:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.034346:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933100672 00000100:00100000:1.0:1789297343.034356:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933100672 00000100:00100000:1.0:1789297343.034446:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 197 00000100:00100000:1.0:1789297343.034458:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+35:11589:x1876213933100672:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:1.0:1789297343.034486:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297343.034535:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c15c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dbfb expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034617:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034629:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034638:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034647:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034652:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034655:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034948:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c171 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034954:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.034959:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c171 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297343.034966:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:1.0:1789297343.035042:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035059:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035065:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035071:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.035075:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035084:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035096:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297343.035098:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297343.035102:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035108:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c163 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035121:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035127:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035132:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035137:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.035146:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035163:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035170:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b08585900) 00010000:00010000:1.0:1789297343.035172:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297343.035173:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035178:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c16a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035211:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c15c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbfb expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035220:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c171 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbfb expref: 37 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.035225:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:1.0:1789297343.035227:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297343.035228:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3600, rc 0) 00000100:00100000:1.0:1789297343.035282:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+37:11589:x1876213933100672:12345-192.168.202.43@tcp:101:cat.0 Request processed in 829us (1104us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1789297343.035287:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 197 00000100:00080000:2.0:1789297343.036018:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297343.045978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.046091:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933100928 00000100:00100000:1.0:1789297343.046102:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933100928 00000100:00100000:1.0:1789297343.046169:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:1.0:1789297343.046180:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+37:11589:x1876213933100928:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:1.0:1789297343.046481:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+38:11589:x1876213933100928:12345-192.168.202.43@tcp:35:cat.0 Request processed in 302us (513us total) trans 4294967481 rc 0/0 00000100:00100000:1.0:1789297343.046489:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 54 00000100:00100000:3.0:1789297343.066879:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297343.066991:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933101184 00000100:00100000:0.0:1789297343.067002:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933101184 00000100:00100000:0.0:1789297343.067066:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 198 00000100:00100000:0.0:1789297343.067078:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+38:11590:x1876213933101184:12345-192.168.202.43@tcp:36:rm.0 00010000:00010000:0.0:1789297343.067137:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1789297343.067171:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c171 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbfb expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067196:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c147 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbf4 expref: 37 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067209:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c10f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbe6 expref: 36 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067241:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b08585100) 00010000:00010000:0.0:1789297343.067254:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297343.067278:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067293:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067303:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067317:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067324:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067330:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067619:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067628:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.067637:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789297343.068258:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00010000:00010000:0.0:1789297343.068325:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068342:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068351:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068358:0:5844:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068364:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068370:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068400:0:5844:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297343.068419:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068425:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068431:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068437:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297343.068441:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068448:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068470:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b15d3af00) 00010000:00010000:0.0:1789297343.068472:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1789297343.068477:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068483:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c18d lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068500:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068507:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068513:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068518:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bae00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297343.068520:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068525:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068532:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:0.0:1789297343.068534:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297343.068536:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.068541:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bae00/0x8ad177e823a0c17f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1789297343.068559:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000fd2f6903 reply state 000000009f84c8c0 transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297343.068567:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1789297343.068665:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+37:11590:x1876213933101184:12345-192.168.202.43@tcp:36:rm.0 Request processed in 1586us (1795us total) trans 4294967482 rc 0/0 00000100:00100000:0.0:1789297343.068673:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 198 00010000:00010000:3.0:1789297343.069433:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297343.069442:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.069462:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297343.069466:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.069473:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.069486:0:5830:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff982b15d3af00) 00010000:00010000:3.0:1789297343.069489:0:5830:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789297343.069492:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.069498:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c194 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.069528:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297343.069530:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297343.069531:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297343.075254:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.075273:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.075282:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.075289:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbc00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297343.075293:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.075302:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.075324:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b15d3a500) 00010000:00010000:0.0:1789297343.075327:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297343.075332:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.075337:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c186 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297343.117231:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.117620:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933101440 00000100:00100000:1.0:1789297343.117633:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933101440 00000100:00100000:1.0:1789297343.117700:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 199 00000100:00100000:1.0:1789297343.117750:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+36:11596:x1876213933101440:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789297343.117787:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297343.117813:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c19b lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc02 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.117951:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.117966:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.117979:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.117994:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.118000:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.118006:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789297343.119044:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:1.0:1789297343.119235:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119248:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119258:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119296:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119303:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119309:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119315:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.119319:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119326:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119339:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297343.119342:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297343.119347:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119353:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c1a2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789297343.119902:0:5842:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000530512b9 reply state 000000003a68a817 transno 4294967483 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297343.119915:0:5842:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1789297343.119957:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c19b lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 39 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119972:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 38 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.119979:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585600) 00010000:00010000:1.0:1789297343.119982:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297343.119984:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2800, rc 0) 00000100:00100000:1.0:1789297343.120106:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+39:11596:x1876213933101440:12345-192.168.202.43@tcp:101:bash.0 Request processed in 2357us (2886us total) trans 4294967483 rc 0/0 00000100:00100000:1.0:1789297343.120115:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 199 00010000:00010000:1.0:1789297343.124931:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.124949:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.124958:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.124964:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.124969:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.124997:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.125016:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b08585900) 00010000:00010000:1.0:1789297343.125018:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297343.125024:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.125030:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c1a9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297343.126508:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297343.126667:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933101568 00000100:00100000:0.0:1789297343.126677:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933101568 00000100:00100000:0.0:1789297343.126771:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:0.0:1789297343.126791:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933101568:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297343.126815:0:6688:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297343.126842:0:6688:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc09 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789297343.126876:0:6688:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297343.126900:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=354s v=(0 0) 00010000:00010000:0.0:1789297343.126905:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297343.126915:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.126935:0:6688:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 8 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.126950:0:6688:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bbc00, rc 0) 00000100:00100000:0.0:1789297343.127022:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933101568:12345-192.168.202.43@tcp:101:bash.0 Request processed in 242us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297343.127028:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:2.0:1789297343.133833:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297343.133933:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933101696 00000100:00100000:0.0:1789297343.133944:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933101696 00000100:00100000:0.0:1789297343.134005:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:0.0:1789297343.134017:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+8:11596:x1876213933101696:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297343.134057:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297343.134077:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc10 expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.134111:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.134121:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789297343.134126:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297343.134132:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 9 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.134169:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 9 pid: 6688 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.134185:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 9 pid: 6688 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297343.134201:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11700:1876213957209728:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297343.134307:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4e40 going to sleep for 11 seconds 00000100:00100000:3.0:1789297343.137628:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.137804:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933101824 00000100:00100000:1.0:1789297343.137818:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933101824 00010000:00010000:1.0:1789297343.137878:0:5827:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 10 pid: 6688 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297343.137930:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:1.0:1789297343.137940:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+10:2353:x1876213933101824:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297343.137963:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297343.137995:0:5827:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 10 pid: 6688 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.138009:0:5827:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 10 pid: 6688 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.138039:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297343.138044:0:5827:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297343.138070:0:5827:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 10 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.138082:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 10 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.138121:0:5827:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 10 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297343.138136:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876213957209856:192.168.202.43@tcp:105: 00000100:00100000:1.0:1789297343.138230:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7240 going to sleep for 11 seconds 00010000:00010000:0.0:1789297343.138666:0:11700:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c1be lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc09 expref: 10 pid: 6688 timeout: 455 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297343.138683:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b2d80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:11700:1876213957209728:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297343.138761:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 9 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.138793:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bae00, rc 0) 00000100:00100000:0.0:1789297343.138829:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+9:11596:x1876213933101696:12345-192.168.202.43@tcp:101:bash.0 Request processed in 4814us (5007us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297343.138836:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:1.0:1789297343.142259:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0000_UUID:5827:1876213957209856:192.168.202.43@tcp:105: 00010000:00010000:1.0:1789297343.142297:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297343.142363:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933101824:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 4423us (4746us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297343.142375:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:3.0:1789297343.147911:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.148027:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933102080 00000100:00100000:1.0:1789297343.148040:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933102080 00000100:00100000:1.0:1789297343.148107:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:1.0:1789297343.148117:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+38:11596:x1876213933102080:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:1.0:1789297343.148891:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+39:11596:x1876213933102080:12345-192.168.202.43@tcp:35:bash.0 Request processed in 769us (987us total) trans 4294967484 rc 0/0 00000100:00100000:1.0:1789297343.148900:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 55 00000100:00100000:3.0:1789297343.304583:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297343.304829:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933102208 00000100:00100000:0.0:1789297343.304842:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933102208 00000100:00100000:0.0:1789297343.304909:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 200 00000100:00100000:0.0:1789297343.304920:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4096f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+39:11612:x1876213933102208:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:0.0:1789297343.304948:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297343.304971:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c1cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc17 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.305038:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c1d3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.305054:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.305068:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297343.305106:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:0.0:1789297343.305110:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297343.305131:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c1d3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.305170:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba400/0x8ad177e823a0c1cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc17 expref: 41 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.305216:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c1d3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc17 expref: 40 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.305225:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:0.0:1789297343.305228:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789297343.305231:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bba00, rc 0) 00000100:00100000:0.0:1789297343.305296:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4096f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+40:11612:x1876213933102208:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 378us (724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297343.305303:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 200 00000100:00100000:0.0:1789297343.309822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297343.309948:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933102464 00000100:00100000:3.0:1789297343.309959:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933102464 00000100:00100000:3.0:1789297343.310029:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:3.0:1789297343.310043:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+40:11612:x1876213933102464:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297343.310066:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297343.310087:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c1da lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc1e expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.310231:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c1e1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.310245:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.310257:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c1e1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297343.310269:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789297343.310540:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c1da lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc1e expref: 43 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.310559:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c1e1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc1e expref: 42 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.310567:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585600) 00010000:00010000:3.0:1789297343.310570:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297343.310573:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e400, rc 0) 00000100:00100000:3.0:1789297343.310774:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+42:11612:x1876213933102464:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 734us (962us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1789297343.310790:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 201 00000100:00100000:2.0:1789297343.316326:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297343.316386:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297343.316635:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933102720 00000100:00100000:0.0:1789297343.316646:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933102720 00000100:00100000:2.0:1789297343.316834:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:2.0:1789297343.316847:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+42:11612:x1876213933102720:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297343.316875:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297343.316897:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0c1ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc25 expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.316997:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c1f6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.317012:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.317023:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c1f6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297343.317051:0:5843:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:2.0:1789297343.317191:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257200/0x8ad177e823a0c1ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc25 expref: 45 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.317209:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc25 expref: 44 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.317217:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585600) 00010000:00010000:2.0:1789297343.317219:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1789297343.317223:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256600, rc 0) 00000100:00100000:2.0:1789297343.317288:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+44:11612:x1876213933102720:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 443us (971us total) trans 4294967486 rc 0/0 00000100:00100000:2.0:1789297343.317295:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 202 00000100:00100000:3.0:1789297343.317836:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933102848 00000100:00100000:3.0:1789297343.317843:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933102848 00000100:00100000:3.0:1789297343.317928:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:3.0:1789297343.317939:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+44:2354:x1876213933102848:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297343.317950:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297343.317975:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c1e1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc1e expref: 44 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.317986:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585600) 00010000:00010000:3.0:1789297343.317989:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297343.318015:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+43:2354:x1876213933102848:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 79us (1629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297343.318021:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:0.0:1789297343.323183:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297343.323268:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933102976 00000100:00100000:2.0:1789297343.323280:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933102976 00000100:00100000:2.0:1789297343.323340:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:2.0:1789297343.323350:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933102976:12345-192.168.202.43@tcp:1:lfs.0 00010000:00010000:2.0:1789297343.323417:0:6688:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.323439:0:6688:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 8 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.323447:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297343.323451:0:6688:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297343.323455:0:6688:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.323523:0:6688:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 8 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.323539:0:6688:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 8 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.323555:0:6688:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3fbb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876213957209984:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297343.323670:0:6688:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b059693c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297343.327861:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297343.328025:0:6688:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3fbb4380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6688:1876213957209984:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297343.328058:0:6688:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297343.328139:0:6692:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933103104 00000100:00100000:3.0:1789297343.328146:0:6692:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933103104 00002000:00100000:3.0:1789297343.328207:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff982b41ef5f80 x1876213933103104/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:204/0 lens 504/0 e 0 to 0 dl 1789297354 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297343.328217:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b41ef5f80 with x1876213933103104 ext(0->8) 00010000:00010000:3.0:1789297343.328224:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 9 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.328237:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 9 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789297343.328245:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff982b41ef5f80 00000100:00100000:3.0:1789297343.328278:0:6692:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:3.0:1789297343.328288:0:6692:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+9:2354:x1876213933103104:12345-192.168.202.43@tcp:4:lfs.0 00000100:00100000:3.0:1789297343.328790:0:6692:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:235dd3df-f928-4719-bb69-fc817cc2744f+11:2354:x1876213933103104:12345-192.168.202.43@tcp:4:lfs.0 Request processed in 502us (938us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1789297343.328799:0:6692:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00002000:00100000:3.0:1789297343.328806:0:6692:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff982b41ef5f80 x1876213933103104/t4294967308(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:204/0 lens 504/448 e 0 to 0 dl 1789297354 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1789297343.328820:0:6692:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b41ef5f80 with x1876213933103104 ext(0->8) 00010000:00010000:3.0:1789297343.328826:0:6692:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 11 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.328838:0:6692:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 11 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789297343.328846:0:6692:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff982b41ef5f80 00000100:00100000:0.0:1789297343.332142:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297343.332263:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933103232 00000100:00100000:2.0:1789297343.332275:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933103232 00010000:00010000:2.0:1789297343.332315:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 11 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.332360:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:2.0:1789297343.332370:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+11:2356:x1876213933103232:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297343.332399:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1789297343.332423:0:5828:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:2.0:1789297343.332426:0:5828:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1789297343 00002000:00010000:2.0:1789297343.332428:0:5828:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1789297343 00002000:00010000:2.0:1789297343.332430:0:5828:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1789297343 00010000:00010000:2.0:1789297343.332450:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 11 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.332465:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 11 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.332489:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c1c5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc10 expref: 11 pid: 11700 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.332519:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297343.332524:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297343.332530:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.332540:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.332574:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297343.332637:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+10:2356:x1876213933103232:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 267us (504us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.332645:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 78 00010000:00010000:0.0:1789297343.332840:0:6688:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332849:0:6688:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332874:0:6688:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332882:0:6688:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332903:0:6688:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332910:0:6688:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297343.332914:0:6688:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332925:0:6688:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332938:0:6688:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.332946:0:6688:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000029641e5/0x8ad177e823a0c204 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6688 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297343.332998:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+9:2354:x1876213933102976:12345-192.168.202.43@tcp:1:lfs.0 Request processed in 9650us (9826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297343.333005:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:2.0:1789297343.336766:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.336926:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933103488 00000100:00100000:1.0:1789297343.336937:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933103488 00000100:00100000:1.0:1789297343.337018:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 56 00000100:00100000:1.0:1789297343.337028:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b13010050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+43:11612:x1876213933103488:12345-192.168.202.43@tcp:35:lfs.0 00000004:00010000:1.0:1789297343.337100:0:5845:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c1f6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc25 expref: 43 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789297343.337438:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:1.0:1789297343.337488:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00000001:00080000:1.0:1789297343.337888:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00010000:00010000:1.0:1789297343.337944:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.337961:0:5845:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.337969:0:5845:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.338009:0:5845:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 47 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.338025:0:5845:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 47 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297343.338038:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1876213957210112:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297343.338129:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7240 going to sleep for 11 seconds 00000100:00100000:3.0:1789297343.341938:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.342057:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5845:1876213957210112:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297343.342091:0:5845:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.342824:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933103616 00000100:00100000:2.0:1789297343.342834:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933103616 00010000:00010000:2.0:1789297343.342870:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 48 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.342950:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:2.0:1789297343.342969:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+48:2353:x1876213933103616:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297343.342986:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297343.342993:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 48 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.343006:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 48 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.343027:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c1b0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc02 expref: 48 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.343043:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585600) 00010000:00010000:2.0:1789297343.343048:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.343057:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.343064:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.343132:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297343.343241:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+47:2353:x1876213933103616:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 271us (1312us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.343248:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 79 00010000:00010000:1.0:1789297343.343351:0:5845:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.343359:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1789297343.343721:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000001:00080000:1.0:1789297343.343933:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:1.0:1789297343.344087:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876213957210240:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789297343.344146:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297343.344396:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b79c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297343.346092:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957210240 00000100:00100000:3.0:1789297343.346109:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957210240 00000100:00100000:2.0:1789297343.346361:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789297343.346372:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1876213957210240:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1789297343.346525:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5845:x1876213957210240:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 155us (2378us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.346546:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297343.346627:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876213957210240:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789297343.348044:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00000100:00100000:1.0:1789297343.348139:0:5845:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876213957210368:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1789297343.348321:0:5845:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297343.348727:0:5845:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eeca80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297343.348808:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957210368 00000100:00100000:0.0:1789297343.348816:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957210368 00000100:00100000:0.0:1789297343.348859:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1789297343.348869:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5845:x1876213957210368:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:0.0:1789297343.349113:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5845:x1876213957210368:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 246us (792us total) trans 4294967309 rc 0/0 00000100:00100000:0.0:1789297343.349135:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297343.349563:0:5845:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e68e00 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5845:1876213957210368:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:1.0:1789297343.349630:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:1.0:1789297343.349674:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.349683:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.349690:0:5845:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.349696:0:5845:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.350589:0:5845:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.350599:0:5845:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.350616:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585600) 00010000:00010000:1.0:1789297343.350618:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:1.0:1789297343.350623:0:5845:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.350629:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c20b lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789297343.350877:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:1.0:1789297343.350982:0:5845:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:1.0:1789297343.350995:0:5845:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 355225290544ns, next at 356225287890ns, rc = 0 00000001:00080000:1.0:1789297343.351003:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967494 00010000:00010000:1.0:1789297343.351048:0:5845:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585600) 00010000:00010000:1.0:1789297343.351052:0:5845:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1789297343.351059:0:5845:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c1f6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc25 expref: 51 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297343.351190:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b13010050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+50:11612:x1876213933103488:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 14163us (14436us total) trans 4294967495 rc 0/0 00000100:00100000:1.0:1789297343.351201:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 56 00000020:00080000:1.0:1789297343.351207:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1789297343.354816:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.354955:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933103744 00000100:00100000:1.0:1789297343.354966:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933103744 00000100:00100000:1.0:1789297343.355030:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:1.0:1789297343.355040:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+50:11612:x1876213933103744:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297343.355078:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297343.355102:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c212 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc2c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.355165:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc2c expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.355181:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c212 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc2c expref: 51 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.355199:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297343.355202:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1789297343.355206:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3a00, rc 0) 00000100:00100000:1.0:1789297343.355258:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+51:11612:x1876213933103744:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 219us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297343.355265:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 203 00000100:00100000:0.0:1789297343.358927:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297343.359016:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933104000 00000100:00100000:3.0:1789297343.359027:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933104000 00000100:00100000:3.0:1789297343.359097:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:3.0:1789297343.359109:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+51:11612:x1876213933104000:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297343.359373:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+52:11612:x1876213933104000:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 266us (456us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1789297343.360091:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 57 00000100:00100000:0.0:1789297343.442848:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297343.442935:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933104128 00000100:00100000:2.0:1789297343.442946:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933104128 00000100:00100000:2.0:1789297343.443000:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 204 00000100:00100000:2.0:1789297343.443009:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+52:11622:x1876213933104128:12345-192.168.202.43@tcp:34:lfs.0 00010000:00010000:2.0:1789297343.443085:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443103:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443114:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443128:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443135:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443141:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443239:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443246:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443253:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1789297343.443309:0:5843:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443321:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443328:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443335:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443341:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297343.443345:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443352:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443363:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297343.443366:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297343.443370:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443625:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c219 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443642:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443648:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443659:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443665:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297343.443668:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443674:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443682:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b2ac85900) 00010000:00010000:2.0:1789297343.443684:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297343.443686:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443692:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c220 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443758:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443765:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443771:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443784:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297343.443788:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443803:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443812:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297343.443814:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297343.443817:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.443823:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256a00/0x8ad177e823a0c227 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.443885:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+52:11622:x1876213933104128:12345-192.168.202.43@tcp:34:lfs.0 Request processed in 875us (1045us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.443891:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 204 00000100:00100000:0.0:1789297343.488663:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.488786:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933104384 00000100:00100000:1.0:1789297343.488801:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933104384 00000100:00100000:1.0:1789297343.488861:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 205 00000100:00100000:1.0:1789297343.488871:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+52:11625:x1876213933104384:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:1.0:1789297343.488892:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297343.488912:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c22e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc33 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.488995:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489011:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489037:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489051:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489059:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489067:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489202:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489211:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489218:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297343.489228:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:1.0:1789297343.489331:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489339:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489345:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489350:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.489361:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489368:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489465:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297343.489470:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297343.489474:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489481:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c235 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489496:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489571:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489578:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489583:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.489587:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489592:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489600:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b08585600) 00010000:00010000:1.0:1789297343.489603:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297343.489615:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489620:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c23c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489666:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c22e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489680:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 54 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.489687:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297343.489689:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297343.489691:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2800, rc 0) 00000100:00100000:1.0:1789297343.489801:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+54:11625:x1876213933104384:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 931us (1148us total) trans 4294967497 rc 0/0 00000100:00100000:1.0:1789297343.489808:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 205 00000100:00100000:0.0:1789297343.494001:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.494079:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933104512 00000100:00100000:1.0:1789297343.494090:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933104512 00000100:00100000:1.0:1789297343.494165:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 206 00000100:00100000:1.0:1789297343.494176:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+54:11625:x1876213933104512:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:1.0:1789297343.494246:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494264:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494276:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494325:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494331:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494338:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494345:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297343.494349:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494358:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494370:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297343.494373:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789297343.494377:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.494398:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c251 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297343.494484:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+54:11625:x1876213933104512:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 309us (491us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297343.494492:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 206 00000100:00100000:0.0:1789297343.497978:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.498051:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933104768 00000100:00100000:1.0:1789297343.498062:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933104768 00000100:00100000:1.0:1789297343.498118:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:1.0:1789297343.498145:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+54:11625:x1876213933104768:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789297343.498414:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+55:11625:x1876213933104768:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 272us (445us total) trans 4294967498 rc 0/0 00000100:00100000:1.0:1789297343.498423:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 58 00000100:00100000:0.0:1789297343.571396:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.571645:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933105024 00000100:00100000:1.0:1789297343.571657:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933105024 00000100:00100000:1.0:1789297343.571747:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 207 00000100:00100000:1.0:1789297343.571758:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+55:11635:x1876213933105024:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789297343.571793:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297343.571797:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789297343.571825:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c1d3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc17 expref: 55 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.571847:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297343.571852:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297343.571866:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c258 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc3a expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.571964:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.571978:0:5842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.571985:0:5842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.572018:0:5842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.572046:0:5842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 55 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297343.572061:0:5842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957210496:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297343.572173:0:5842:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297343.578629:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.578764:0:5842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e6b480 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5842:1876213957210496:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297343.578827:0:5842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.579350:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933105152 00000100:00100000:2.0:1789297343.579359:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933105152 00010000:00010000:2.0:1789297343.579574:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 56 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.579661:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:2.0:1789297343.579671:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+56:2353:x1876213933105152:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297343.579689:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297343.579696:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 56 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.579725:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 56 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.579768:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2800/0x8ad177e823a0c243 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc33 expref: 56 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.579797:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297343.579803:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.579812:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.579820:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.579906:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297343.579971:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcf800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+55:2353:x1876213933105152:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 301us (1353us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.579980:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00010000:00010000:3.0:1789297343.581205:0:5842:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.581219:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297343.581241:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1789297343.583817:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2000/0x8ad177e823a0c258 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 56 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.583875:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 55 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.583884:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:3.0:1789297343.583887:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1789297343.583890:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3000, rc 0) 00000100:00100000:3.0:1789297343.583967:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+55:11635:x1876213933105024:12345-192.168.202.43@tcp:101:bash.0 Request processed in 12210us (12596us total) trans 4294967499 rc 0/0 00000100:00100000:3.0:1789297343.583977:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 207 00000100:00100000:3.0:1789297343.587264:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297343.587314:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933105408 00000100:00100000:3.0:1789297343.587326:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933105408 00000100:00100000:3.0:1789297343.587414:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 208 00000100:00100000:3.0:1789297343.587426:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+55:11635:x1876213933105408:12345-192.168.202.43@tcp:36:bash.0 00010000:00010000:3.0:1789297343.587747:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.587764:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.587783:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297343.587846:0:5844:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967500 00000004:00010000:3.0:1789297343.587872:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000099ce2aa7 reply state 000000003e436789 transno 4294967501 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297343.587894:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297343.587985:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+58:11635:x1876213933105408:12345-192.168.202.43@tcp:36:bash.0 Request processed in 561us (733us total) trans 4294967501 rc 0/0 00000100:00100000:3.0:1789297343.587992:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 208 00000020:00080000:3.0:1789297343.587997:0:5844:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789297343.590148:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.590166:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.590174:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.590180:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297343.590184:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.590210:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.590226:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297343.590229:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297343.590234:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.590239:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c26d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297343.591762:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297343.591879:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933105536 00000100:00100000:0.0:1789297343.591889:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933105536 00000100:00100000:0.0:1789297343.591948:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 209 00000100:00100000:0.0:1789297343.591959:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+57:11635:x1876213933105536:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297343.591984:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297343.592003:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c274 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc41 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.592088:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.592101:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.592109:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.592145:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 58 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.592177:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 58 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297343.592191:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b277dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957210624:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297343.592342:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4e40 going to sleep for 11 seconds 00000100:00100000:0.0:1789297343.595813:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297343.595925:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b277dea00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957210624:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297343.595955:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.596029:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933105664 00000100:00100000:2.0:1789297343.596038:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933105664 00010000:00010000:2.0:1789297343.596073:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 59 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.596113:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:2.0:1789297343.596122:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+59:2354:x1876213933105664:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297343.596138:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297343.596145:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 59 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.596155:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 59 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.596176:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c25f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc3a expref: 59 pid: 5842 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.596210:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297343.596215:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.596224:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.596231:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.596261:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297343.596318:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+58:2354:x1876213933105664:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 197us (517us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.596326:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 81 00010000:00010000:0.0:1789297343.596528:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.596536:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297343.596581:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789297343.596585:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297343.596607:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.596637:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c274 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 58 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.596653:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 57 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297343.596660:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:0.0:1789297343.596663:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297343.596665:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb000, rc 0) 00000100:00100000:0.0:1789297343.596692:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+57:11635:x1876213933105536:12345-192.168.202.43@tcp:101:bash.0 Request processed in 4736us (4939us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297343.596738:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 209 00000100:00100000:2.0:1789297343.600676:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.600883:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933105920 00000100:00100000:1.0:1789297343.600893:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933105920 00000100:00100000:1.0:1789297343.600958:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:1.0:1789297343.600969:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+57:11635:x1876213933105920:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:1.0:1789297343.601222:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+58:11635:x1876213933105920:12345-192.168.202.43@tcp:35:bash.0 Request processed in 255us (555us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1789297343.601231:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 59 00000100:00100000:1.0:1789297343.657395:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297343.657625:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933106048 00000100:00100000:3.0:1789297343.657636:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933106048 00000100:00100000:3.0:1789297343.657737:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 210 00000100:00100000:3.0:1789297343.657751:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+58:11641:x1876213933106048:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297343.657784:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297343.657804:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c282 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc48 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.657868:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c289 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.657881:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.657893:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297343.657928:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 16384 00000004:00200000:3.0:1789297343.657947:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297343.657971:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c289 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.657996:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c282 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc48 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.658016:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c289 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc48 expref: 59 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.658025:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297343.658027:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297343.658031:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e000, rc 0) 00000100:00100000:3.0:1789297343.658091:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e6b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+59:11641:x1876213933106048:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 343us (716us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297343.658098:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 210 00000100:00100000:2.0:1789297343.661466:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297343.661605:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933106176 00000100:00100000:3.0:1789297343.661614:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933106176 00000100:00100000:3.0:1789297343.661679:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:3.0:1789297343.661691:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+59:11641:x1876213933106176:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297343.661740:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297343.661761:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0c290 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc4f expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.661843:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.661858:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.661889:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.661904:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.661911:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.661917:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662008:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c2a5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662017:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662024:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297343.662062:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1789297343.662066:0:5842:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297343.662085:0:5842:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662096:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c2a5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662103:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662121:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662128:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662133:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297343.662138:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662146:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662170:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:3.0:1789297343.662174:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297343.662178:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662185:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e800/0x8ad177e823a0c297 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662200:0:5842:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662206:0:5842:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662212:0:5842:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662217:0:5842:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297343.662226:0:5842:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662232:0:5842:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662240:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b03073000) 00010000:00010000:3.0:1789297343.662242:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297343.662244:0:5842:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662250:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fa00/0x8ad177e823a0c29e lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662285:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f800/0x8ad177e823a0c290 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc4f expref: 61 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662298:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c2a5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc4f expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.662305:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:3.0:1789297343.662307:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297343.662310:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148ea00, rc 0) 00000100:00100000:3.0:1789297343.662366:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+60:11641:x1876213933106176:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 678us (911us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297343.662372:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 211 00000100:00100000:0.0:1789297343.665823:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297343.665869:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.665961:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933106560 00000100:00100000:1.0:1789297343.665973:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933106560 00000100:00100000:1.0:1789297343.666048:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:1.0:1789297343.666060:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+60:2355:x1876213933106560:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297343.666077:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297343.666102:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148ea00/0x8ad177e823a0c2a5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc4f expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.666140:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297343.666145:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297343.666211:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02e82c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+59:2355:x1876213933106560:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 153us (340us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297343.666218:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789297343.667097:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933106432 00000100:00100000:3.0:1789297343.667107:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933106432 00000100:00100000:3.0:1789297343.667171:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00100000:3.0:1789297343.667182:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+59:11641:x1876213933106432:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297343.667216:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297343.667235:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c2ac lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc56 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.667357:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.667372:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 60 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.667395:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.667435:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 60 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.667450:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 60 pid: 7920 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297343.667463:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b120ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957210752:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297343.667924:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051d7c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297343.671353:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b120ad880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957210752:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297343.671465:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297343.673997:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297343.674091:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933106688 00000100:00100000:2.0:1789297343.674101:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933106688 00010000:00010000:2.0:1789297343.674141:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 61 pid: 7920 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297343.674194:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:2.0:1789297343.674204:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+61:2353:x1876213933106688:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297343.674220:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297343.674227:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 61 pid: 7920 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.674259:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 61 pid: 7920 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.674281:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb000/0x8ad177e823a0c27b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc41 expref: 61 pid: 7920 timeout: 455 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.674299:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297343.674304:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.674314:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.674322:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.674391:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297343.674457:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+60:2353:x1876213933106688:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 254us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.674466:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 82 00010000:00010000:1.0:1789297343.674587:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.674595:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297343.674616:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1789297343.674817:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c2ac lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.674834:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 60 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.674842:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297343.674845:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1789297343.674848:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152ba00, rc 0) 00000100:00100000:1.0:1789297343.674874:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+60:11641:x1876213933106432:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 7695us (9063us total) trans 4294967503 rc 0/0 00000100:00100000:1.0:1789297343.674881:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 212 00000100:00100000:0.0:1789297343.678979:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297343.679137:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933106944 00000100:00100000:1.0:1789297343.679148:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933106944 00000100:00100000:1.0:1789297343.679228:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:1.0:1789297343.679253:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+60:11641:x1876213933106944:12345-192.168.202.43@tcp:103:lfs.0 00010000:00010000:1.0:1789297343.679272:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297343.679299:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c212 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc2c expref: 60 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297343.679318:0:5827:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297343.679323:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297343.679559:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:235dd3df-f928-4719-bb69-fc817cc2744f+59:11641:x1876213933106944:12345-192.168.202.43@tcp:103:lfs.0 Request processed in 307us (591us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297343.679567:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789297343.682618:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297343.682905:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933107072 00000100:00100000:3.0:1789297343.682918:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933107072 00000100:00100000:3.0:1789297343.683024:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 213 00000100:00100000:3.0:1789297343.683055:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+59:11641:x1876213933107072:12345-192.168.202.43@tcp:58:lfs.0 00010000:00010000:3.0:1789297343.683174:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.683193:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297343.683206:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789297343.683417:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:3.0:1789297343.683522:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+59:11641:x1876213933107072:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 471us (913us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297343.683530:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 213 00000100:00100000:0.0:1789297343.687220:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297343.687602:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933107200 00000100:00100000:2.0:1789297343.687613:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933107200 00000100:00100000:2.0:1789297343.687764:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 214 00000100:00100000:2.0:1789297343.687802:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+59:11641:x1876213933107200:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297343.687836:0:5843:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297343.687881:0:5843:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc5d expref: -99 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.688030:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.688051:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.688090:0:5843:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.688118:0:5843:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.688145:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297343.688148:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789297343.688166:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 60 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297343.688174:0:5843:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257e00, rc 0) 00000100:00100000:2.0:1789297343.688257:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+60:11641:x1876213933107200:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 483us (1046us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297343.688263:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 214 00000001:00080000:1.0:1789297343.984265:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1789297343.984383:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:1.0:1789297343.984613:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00010000:00010000:2.0:1789297343.996992:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297344.445011:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789297344.445022:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789297344.445063:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:1.0:1789297344.445070:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789297344.445436:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11e69180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957210880:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789297344.445843:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b067b7900 going to sleep for 11 seconds 00000100:00100000:1.0:1789297344.453530:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11e69180 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957210880:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1789297344.454190:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297344.454404:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933107328 00000100:00100000:3.0:1789297344.454413:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933107328 00000100:00100000:3.0:1789297344.454481:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00100000:3.0:1789297344.454491:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+60:11642:x1876213933107328:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1789297344.454540:0:7920:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1789297344.454824:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+60:11642:x1876213933107328:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 333us (634us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297344.454832:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 215 00000100:00100000:0.0:1789297344.460051:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.460146:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933107456 00000100:00100000:1.0:1789297344.460157:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933107456 00000100:00100000:1.0:1789297344.460219:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 216 00000100:00100000:1.0:1789297344.460230:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+60:11642:x1876213933107456:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:1.0:1789297344.460302:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460336:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460350:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460366:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460373:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460379:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460400:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460408:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460415:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297344.460450:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:1.0:1789297344.460453:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297344.460475:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460486:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460504:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460510:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460516:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297344.460520:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460528:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460540:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:1.0:1789297344.460543:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297344.460548:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460554:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c2cf lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460567:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460573:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460579:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460584:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297344.460591:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460597:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460605:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff982b08585e00) 00010000:00010000:1.0:1789297344.460607:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297344.460610:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460616:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c2d6 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460629:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460636:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460642:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460646:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297344.460649:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460655:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460661:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297344.460663:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297344.460670:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.460676:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2dd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.460812:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024be680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+60:11642:x1876213933107456:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 583us (771us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.460819:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 216 00000100:00100000:2.0:1789297344.472120:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297344.472207:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933107712 00000100:00100000:3.0:1789297344.472218:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933107712 00000100:00100000:3.0:1789297344.472273:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 217 00000100:00100000:3.0:1789297344.472284:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+60:11642:x1876213933107712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297344.472308:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297344.472341:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c2e4 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc64 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.472459:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.472893:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.472911:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297344.472925:0:7920:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:3.0:1789297344.473036:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473044:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473051:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473057:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297344.473062:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473069:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473082:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:3.0:1789297344.473085:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1789297344.473089:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473109:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c2eb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473157:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c2e4 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc64 expref: 62 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473168:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:3.0:1789297344.473170:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789297344.473174:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c2e4 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc64 expref: 62 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.473183:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b600, rc 0) 00000100:00100000:3.0:1789297344.473245:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3fbb5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+61:11642:x1876213933107712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 963us (1136us total) trans 4294967504 rc 301/301 00000100:00100000:3.0:1789297344.473253:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 217 00000100:00100000:3.0:1789297344.475325:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.475395:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933107840 00000100:00100000:1.0:1789297344.475404:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933107840 00000100:00100000:1.0:1789297344.475459:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 218 00000100:00100000:1.0:1789297344.475475:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+61:11642:x1876213933107840:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1789297344.475515:0:5844:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789297344.475613:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120ad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+61:11642:x1876213933107840:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 146us (296us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.475620:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 218 00000100:00100000:0.0:1789297344.478357:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.478452:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933108096 00000100:00100000:1.0:1789297344.478464:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933108096 00000100:00100000:1.0:1789297344.478546:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 219 00000100:00100000:1.0:1789297344.478557:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+61:11642:x1876213933108096:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297344.478580:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297344.478583:0:5842:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:1.0:1789297344.478618:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c289 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc48 expref: 61 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.478638:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297344.478643:0:5842:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297344.478672:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2f9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc6b expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789297344.479131:0:5842:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:1.0:1789297344.479344:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c300 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.479358:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.479369:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c300 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.479425:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c2f9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc6b expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.479442:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c300 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc6b expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.479451:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585e00) 00010000:00010000:1.0:1789297344.479453:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297344.479456:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3600, rc 0) 00000100:00100000:1.0:1789297344.479518:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+62:11642:x1876213933108096:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 962us (1172us total) trans 4294967505 rc 0/0 00000100:00100000:1.0:1789297344.479527:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 219 00000100:00100000:0.0:1789297344.484828:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.484902:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933108352 00000100:00100000:1.0:1789297344.484915:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933108352 00000100:00100000:1.0:1789297344.484984:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 220 00000100:00100000:1.0:1789297344.484995:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+62:11642:x1876213933108352:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789297344.485086:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297344.485113:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3600/0x8ad177e823a0c300 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc6b expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485131:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585e00) 00010000:00010000:1.0:1789297344.485143:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297344.485166:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485182:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485194:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485210:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485217:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485223:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485289:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485297:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485304:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485316:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297344.485320:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485328:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485337:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:1.0:1789297344.485339:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297344.485343:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485349:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3a00/0x8ad177e823a0c30e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485359:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485365:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485371:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485376:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297344.485378:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485385:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485404:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8fe5a78b (ffff982b08585600) 00010000:00010000:1.0:1789297344.485407:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297344.485410:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.485416:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c315 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8fe5a78b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.485682:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+61:11642:x1876213933108352:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 688us (873us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789297344.485690:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 220 00000100:00100000:0.0:1789297344.488918:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.489023:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933108480 00000100:00100000:1.0:1789297344.489036:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933108480 00000100:00100000:1.0:1789297344.489138:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 221 00000100:00100000:1.0:1789297344.489149:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+61:11642:x1876213933108480:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297344.489173:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297344.489198:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c31c lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc72 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.489236:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.489252:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.489262:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.489375:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2200/0x8ad177e823a0c31c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 63 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.489403:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 62 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.489412:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:1.0:1789297344.489416:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789297344.489419:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3200, rc 0) 00000100:00100000:1.0:1789297344.489536:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+62:11642:x1876213933108480:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 389us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.489543:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 221 00000100:00100000:0.0:1789297344.498061:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.498473:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933108736 00000100:00100000:1.0:1789297344.498483:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933108736 00000100:00100000:1.0:1789297344.498545:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00100000:1.0:1789297344.498556:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+62:11642:x1876213933108736:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789297344.498654:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.498673:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.498685:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789297344.498988:0:5844:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00080000:1.0:1789297344.498998:0:5844:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 356373293220ns, next at 357373290820ns, rc = 0 00000004:00010000:1.0:1789297344.499085:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000edf28eaf reply state 00000000fa31f798 transno 4294967506 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.499111:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789297344.499210:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+64:11642:x1876213933108736:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 654us (1158us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1789297344.499219:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 222 00000100:00100000:2.0:1789297344.507514:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.507603:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933108864 00000100:00100000:0.0:1789297344.507613:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933108864 00000100:00100000:0.0:1789297344.507675:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 223 00000100:00100000:0.0:1789297344.507685:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+64:11642:x1876213933108864:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297344.507727:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297344.507747:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc79 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.507829:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 65 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.507846:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 65 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.507887:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:0.0:1789297344.507891:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297344.507895:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bbc00, rc 0) 00000100:00100000:0.0:1789297344.507959:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+65:11642:x1876213933108864:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 276us (454us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297344.507966:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 223 00010000:00010000:1.0:1789297344.508306:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.508316:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.508324:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.508335:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297344.508341:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.508349:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.508362:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:1.0:1789297344.508365:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789297344.508369:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.508375:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3000/0x8ad177e823a0c32a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.510491:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.510578:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933108992 00000100:00100000:1.0:1789297344.510588:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933108992 00000100:00100000:1.0:1789297344.510681:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:1.0:1789297344.510691:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:2355:x1876213933108992:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00080000:2.0:1789297344.510982:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297344.511435:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+10:2355:x1876213933108992:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 742us (951us total) trans 4294967319 rc 0/0 00000100:00100000:0.0:1789297344.511445:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:2.0:1789297344.517232:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.517313:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933109248 00000100:00100000:1.0:1789297344.517324:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933109248 00000100:00100000:1.0:1789297344.517394:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:1.0:1789297344.517406:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+64:11642:x1876213933109248:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789297344.517661:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+65:11642:x1876213933109248:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 257us (440us total) trans 4294967507 rc 0/0 00000100:00100000:1.0:1789297344.517669:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 60 00000100:00100000:3.0:1789297344.521619:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.521699:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933109504 00000100:00100000:1.0:1789297344.521726:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933109504 00000100:00100000:1.0:1789297344.521804:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 224 00000100:00100000:1.0:1789297344.521817:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+65:11642:x1876213933109504:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:1.0:1789297344.522616:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+65:11642:x1876213933109504:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 796us (1001us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.522626:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 224 00000100:00100000:3.0:1789297344.524914:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.525329:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933109632 00000100:00100000:0.0:1789297344.525340:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933109632 00000100:00100000:0.0:1789297344.525410:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 225 00000100:00100000:0.0:1789297344.525421:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+65:11642:x1876213933109632:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297344.525443:0:7920:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297344.525467:0:7920:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c338 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc80 expref: -99 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.525608:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c33f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.525623:0:7920:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.525636:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297344.525693:0:7920:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297344.525759:0:7920:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c33f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.525802:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba800/0x8ad177e823a0c338 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc80 expref: 67 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.525822:0:7920:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c33f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc80 expref: 66 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.526320:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:0.0:1789297344.526324:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789297344.526328:0:7920:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bba00, rc 0) 00000100:00100000:0.0:1789297344.526674:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+66:11642:x1876213933109632:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1251us (1767us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297344.526683:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 225 00000100:00100000:2.0:1789297344.530414:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297344.530525:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933109760 00000100:00100000:3.0:1789297344.530537:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933109760 00000100:00100000:3.0:1789297344.530600:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:3.0:1789297344.530612:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+10:2354:x1876213933109760:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1789297344.530631:0:6687:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297344.530652:0:6687:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc87 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1789297344.530692:0:6687:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa682c0, blocks: 0x1 00010000:00010000:3.0:1789297344.530753:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789297344.530759:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297344.530781:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.530803:0:6687:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 11 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.530817:0:6687:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b600, rc 0) 00000100:00100000:3.0:1789297344.530888:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+11:2354:x1876213933109760:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 279us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297344.530896:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:2.0:1789297344.534609:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.534747:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933110016 00000100:00100000:0.0:1789297344.534758:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933110016 00000100:00100000:0.0:1789297344.534817:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 226 00000100:00100000:0.0:1789297344.534826:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+66:11642:x1876213933110016:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1789297344.534933:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40cb4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+66:11642:x1876213933110016:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 106us (334us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297344.534942:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 226 00000100:00100000:0.0:1789297344.538013:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297344.538963:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933110144 00000100:00100000:2.0:1789297344.538978:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933110144 00000100:00100000:2.0:1789297344.539050:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789297344.539067:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b12025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+11:11642:x1876213933110144:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297344.539089:0:11700:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297344.539109:0:11700:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc8e expref: -99 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.539143:0:11700:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.539153:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297344.539158:0:11700:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297344.539164:0:11700:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 12 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.539205:0:11700:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 12 pid: 6687 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.539223:0:11700:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 12 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297344.539240:0:11700:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40cb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11700:1876213957211008:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297344.539359:0:11700:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12324180 going to sleep for 11 seconds 00000100:00100000:2.0:1789297344.544922:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.546246:0:11700:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40cb4700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:11700:1876213957211008:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297344.546296:0:11700:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 12 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.546337:0:11700:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256a00, rc 0) 00000100:00100000:0.0:1789297344.546427:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b12025050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+12:11642:x1876213933110144:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 7362us (8425us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297344.546436:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:3.0:1789297344.549203:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933110272 00000100:00100000:3.0:1789297344.549217:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933110272 00010000:00010000:2.0:1789297344.552806:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 12 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297344.553271:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:3.0:1789297344.553289:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+12:2353:x1876213933110272:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297344.553307:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297344.553331:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 12 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.553349:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 12 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.554234:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0c346 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc87 expref: 12 pid: 6687 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.554254:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297344.554259:0:5826:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297344.554268:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 11 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.554279:0:5826:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 11 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.554322:0:5826:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 11 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297344.554338:0:5826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1876213957211136:192.168.202.43@tcp:105: 00000100:00100000:3.0:1789297344.554823:0:5826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b013f1300 going to sleep for 11 seconds 00000100:00100000:2.0:1789297344.564174:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.566687:0:6693:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933110400 00000100:00100000:0.0:1789297344.566736:0:6693:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933110400 00002000:00100000:0.0:1789297344.566805:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff982b0621ed80 x1876213933110400/t0(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:205/0 lens 504/0 e 0 to 0 dl 1789297355 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789297344.566818:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b0621ed80 with x1876213933110400 ext(0->12) 00002000:00010000:0.0:1789297344.566824:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b0621ed80 00000100:00100000:0.0:1789297344.566861:0:6693:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:0.0:1789297344.566870:0:6693:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:235dd3df-f928-4719-bb69-fc817cc2744f+12:2353:x1876213933110400:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1789297344.567574:0:6693:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:235dd3df-f928-4719-bb69-fc817cc2744f+14:2353:x1876213933110400:12345-192.168.202.43@tcp:4:lhsmtool_posix.0 Request processed in 494us (3202us total) trans 4294967320 rc 0/0 00000100:00100000:0.0:1789297344.567587:0:6693:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00002000:00100000:0.0:1789297344.567596:0:6693:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff982b0621ed80 x1876213933110400/t4294967320(0) o4->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:205/0 lens 504/448 e 0 to 0 dl 1789297355 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789297344.567605:0:6693:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b0621ed80 with x1876213933110400 ext(0->12) 00002000:00010000:0.0:1789297344.567610:0:6693:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b0621ed80 00000100:00100000:3.0:1789297344.568060:0:5826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941880 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0001_UUID:5826:1876213957211136:192.168.202.43@tcp:105: 00010000:00010000:3.0:1789297344.568163:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297344.568319:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+13:2353:x1876213933110272:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 15036us (23409us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297344.568329:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:2.0:1789297344.570993:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297344.571505:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933110528 00000100:00100000:3.0:1789297344.571518:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933110528 00000100:00100000:3.0:1789297344.571590:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 227 00000100:00100000:3.0:1789297344.571601:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+66:11642:x1876213933110528:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000100:00100000:2.0:1789297344.628735:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+66:11642:x1876213933110528:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 57102us (57720us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297344.628750:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 227 00000001:00080000:0.0:1789297344.628960:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967482 is committed 00000001:00080000:0.0:1789297344.628978:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967507 is committed 00000004:00080000:0.0:1789297344.628984:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000004:00080000:0.0:1789297344.629095:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:0.0:1789297344.629135:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b067b76c0 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:0.0:1789297344.629139:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b0500f900 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b12fb7a80 00000020:00080000:0.0:1789297344.629143:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b0500f000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982b27aedc00 00000020:00080000:0.0:1789297344.629218:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b051d7000 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:0.0:1789297344.629222:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b11e02900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b051d7cc0 00000020:00080000:0.0:1789297344.629224:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b11e02500 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a01f81400 00000020:00080000:0.0:1789297344.629238:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:0.0:1789297344.629250:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000020:00080000:0.0:1789297344.629462:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:2.0:1789297344.629816:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957211392:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789297344.629955:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297344.630018:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789297344.630098:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957211264:0@lo:6:osp-syn-1-0.0 00000100:00100000:2.0:1789297344.630122:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297344.630155:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957211392 00000100:00100000:2.0:1789297344.630162:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957211392 00000100:00100000:2.0:1789297344.630216:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957211264 00000100:00100000:2.0:1789297344.630219:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957211264 00000100:00100000:2.0:1789297344.630240:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789297344.630250:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957211392:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1789297344.630412:0:6687:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1789297344.630416:0:6687:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1789297344 00002000:00010000:2.0:1789297344.630418:0:6687:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:2.0:1789297344.630420:0:6687:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789297344 -> 1789297344 00002000:00010000:2.0:1789297344.630423:0:6687:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:2.0:1789297344.630468:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3303:x1876213957211392:12345-0@lo:2:osp-syn-1-0.0 Request processed in 220us (514us total) trans 4294967321 rc 0/0 00000100:00100000:2.0:1789297344.630476:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789297344.630646:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789297344.630652:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957211264:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1789297344.630664:0:6687:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:2.0:1789297344.630681:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.630735:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.630746:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1789297344.630751:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297344.630756:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.630797:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 12 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.630811:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 12 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789297344.630976:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789297344.631004:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957211648:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297344.631117:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b08e68cc0 going to sleep for 11 seconds 00000004:00080000:2.0:1789297344.631153:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b38224700/2, rc 0, transno 4294967321 00000100:00100000:2.0:1789297344.631163:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957211392:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1789297344.634136:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789297344.634172:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957211520:0@lo:6:osp-syn-0-0.0 00000100:00100000:0.0:1789297344.634255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297344.634732:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957211520 00000100:00100000:3.0:1789297344.634748:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957211520 00000100:00100000:3.0:1789297344.634839:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1789297344.634849:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957211520:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:3.0:1789297344.634880:0:6689:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:3.0:1789297344.634909:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6aa682bf, atime: 0x6aa682bf, ctime: 0x6aa682bf, blocks: 0xb 00010000:00010000:3.0:1789297344.634915:0:6689:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.634928:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=356s v=(0 0) 00010000:00010000:3.0:1789297344.634932:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297344.634936:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.634949:0:6689:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.634956:0:6689:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.634961:0:6689:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.634975:0:6689:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1789297344.635658:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957211520:12345-0@lo:6:osp-syn-0-0.0 Request processed in 810us (1402us total) trans 4294967310 rc 0/0 00000100:00100000:3.0:1789297344.635664:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00010000:00010000:3.0:1789297344.635686:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297344.635698:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.635734:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297344.635739:0:7634:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.635746:0:7634:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.635761:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.635778:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004eb674cd/0x8ad177e823a0c35b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.635806:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297344.635808:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297344.635809:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789297344.635831:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789297344.636063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.636102:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297344.636171:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957211648:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297344.636203:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297344.636230:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933110784 00000100:00100000:2.0:1789297344.636236:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933110784 00000100:00100000:2.0:1789297344.636307:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:2.0:1789297344.636315:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+13:2354:x1876213933110784:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000100:00100000:1.0:1789297344.636396:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933110656 00000100:00100000:1.0:1789297344.636401:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933110656 00010000:00010000:1.0:1789297344.636421:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 14 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.636443:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:1.0:1789297344.636448:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+14:2354:x1876213933110656:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297344.636458:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297344.636464:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 14 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.636483:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 14 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.636512:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c116 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbed expref: 14 pid: 6687 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.636523:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297344.636527:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297344.636532:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.636541:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.636561:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297344.636602:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+13:2354:x1876213933110656:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 153us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.636609:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00010000:00010000:2.0:1789297344.636906:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.636916:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.636926:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.636934:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.636957:0:6687:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297344.637017:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297344.637032:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.637039:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297344.637043:0:5830:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.637062:0:5830:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.637075:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.637083:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.637097:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297344.637099:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297344.637101:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297344.637407:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+8:3303:x1876213957211264:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6753us (7282us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1789297344.637414:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000004:00080000:1.0:1789297344.637452:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b0621fb80/2, rc 0, transno 4294967322 00000100:00100000:1.0:1789297344.637458:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957211264:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1789297344.637946:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:3.0:1789297344.637953:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967309 00000004:00080000:3.0:1789297344.637971:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b27af4380, transno 4294967307 00000004:00080000:3.0:1789297344.637981:0:3305:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:3.0:1789297344.638283:0:3305:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982b40941880 x1876213957211520/t4294967310(4294967310) o6->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789297360 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-0-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1789297344.638293:0:3305:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b40941880/2, rc 0, transno 4294967310 00000100:00100000:3.0:1789297344.638298:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40941880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957211520:0@lo:6:osp-syn-0-0.0 00000001:00080000:0.0:1789297344.660628:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:0.0:1789297344.660656:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000001:00080000:0.0:1789297344.660662:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000100:00100000:3.0:1789297344.660915:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933110784:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 24595us (24806us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297344.660927:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:0.0:1789297344.664461:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.664558:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933111040 00000100:00100000:1.0:1789297344.664566:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933111040 00000100:00100000:1.0:1789297344.664638:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 228 00000100:00100000:1.0:1789297344.664646:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+20:11642:x1876213933111040:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789297344.664695:0:5844:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297344.664836:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c33f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc80 expref: 20 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.664858:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:1.0:1789297344.664863:0:5844:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297344.664896:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.664928:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.664936:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789297344.665608:0:5844:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000a38b1d87 reply state 000000005be873bd transno 4294967508 ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.665620:0:5844:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789297344.665843:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+21:11642:x1876213933111040:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 1195us (1388us total) trans 4294967508 rc 0/0 00000100:00100000:1.0:1789297344.665852:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 228 00010000:00010000:2.0:1789297344.667756:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.667786:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.667794:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.667800:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297344.667805:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.667813:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.667833:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:2.0:1789297344.667836:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297344.667841:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.667847:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2e00/0x8ad177e823a0c362 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.669556:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.669603:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933111168 00000100:00100000:1.0:1789297344.669613:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933111168 00000100:00100000:1.0:1789297344.669662:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:1.0:1789297344.669672:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933111168:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1789297344.669950:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:1.0:1789297344.669953:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1789297344 -> 1789297343 00002000:00010000:1.0:1789297344.669955:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1789297343 00002000:00010000:1.0:1789297344.669956:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1789297344 -> 1789297343 00002000:00010000:1.0:1789297344.669958:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1789297344.670010:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b385a0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933111168:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 339us (463us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1789297344.670017:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 70 00000100:00100000:1.0:1789297344.671463:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.671575:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933111424 00000100:00100000:0.0:1789297344.671585:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933111424 00000100:00100000:0.0:1789297344.671675:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 229 00000100:00100000:0.0:1789297344.671684:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+20:11642:x1876213933111424:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 00010000:00010000:0.0:1789297344.671793:0:7920:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.671812:0:7920:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.671836:0:7920:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.671874:0:7920:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 20 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.671889:0:7920:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 20 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.671903:0:7920:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957211776:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297344.671976:0:7920:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b053cf9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297344.676789:0:7920:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:7920:1876213957211776:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297344.676823:0:7920:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.678892:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297344.678980:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933111552 00000100:00100000:2.0:1789297344.678990:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933111552 00010000:00010000:2.0:1789297344.679026:0:7633:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 21 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297344.679074:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:2.0:1789297344.679085:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+21:2354:x1876213933111552:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297344.679100:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297344.679114:0:7633:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 21 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.679126:0:7633:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 21 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.679149:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b3200/0x8ad177e823a0c323 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc72 expref: 21 pid: 5842 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.679165:0:7633:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:2.0:1789297344.679170:0:7633:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.679281:0:7633:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.679290:0:7633:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.679319:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297344.679401:0:7920:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679411:0:7920:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679439:0:7920:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679447:0:7920:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679454:0:7920:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679467:0:7920:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297344.679471:0:7920:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679480:0:7920:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679500:0:7920:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:0.0:1789297344.679503:0:7920:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1789297344.679507:0:7920:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.679513:0:7920:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c369 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 7920 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.679589:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+20:11642:x1876213933111424:12345-192.168.202.43@tcp:55:lhsmtool_posix.0 Request processed in 7905us (8134us total) trans 0 rc -22/-22 00000100:00100000:0.0:1789297344.679598:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 229 00000100:00100000:2.0:1789297344.679779:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:235dd3df-f928-4719-bb69-fc817cc2744f+19:2354:x1876213933111552:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 696us (893us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297344.679795:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:3.0:1789297344.683979:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297344.684256:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933111680 00000100:00100000:2.0:1789297344.684268:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933111680 00000100:00100000:2.0:1789297344.684332:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:2.0:1789297344.684343:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933111680:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1789297344.684491:0:6687:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.684539:0:6687:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 8 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.684548:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297344.684552:0:6687:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1789297344.684557:0:6687:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.684593:0:6687:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 8 pid: 11700 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.684608:0:6687:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 8 pid: 11700 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297344.684625:0:6687:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957211904:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297344.685484:0:6687:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b10eec900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297344.688696:0:6687:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38227480 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0001_UUID:6687:1876213957211904:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297344.689429:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00010000:00010000:2.0:1789297344.689738:0:6687:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.690245:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933111808 00000100:00100000:1.0:1789297344.690254:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933111808 00010000:00010000:1.0:1789297344.690295:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 9 pid: 11700 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.690344:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00100000:1.0:1789297344.690355:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+9:2353:x1876213933111808:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297344.690384:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297344.690411:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 9 pid: 11700 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.690426:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 9 pid: 11700 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.690448:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000efcc4652/0x8ad177e823a0c34d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc8e expref: 9 pid: 11700 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.690464:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297344.690468:0:5828:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1789297344.690473:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.690583:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.690621:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297344.690797:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933111808:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 441us (1370us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.690824:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 86 00010000:00010000:2.0:1789297344.692167:0:6687:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692190:0:6687:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692236:0:6687:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692245:0:6687:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692253:0:6687:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692260:0:6687:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297344.692266:0:6687:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692275:0:6687:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692292:0:6687:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.692299:0:6687:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008ddb015/0x8ad177e823a0c370 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6687 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297344.692615:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40940380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+7:2354:x1876213933111680:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 8269us (8691us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297344.692626:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 71 00000100:00100000:3.0:1789297344.695216:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297344.695620:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933112064 00000100:00100000:0.0:1789297344.695632:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933112064 00000100:00100000:0.0:1789297344.696655:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 230 00000100:00100000:0.0:1789297344.696682:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+19:11642:x1876213933112064:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789297344.696916:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.697036:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.697050:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.697260:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.697272:0:5843:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 20 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.697281:0:5843:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.697320:0:5843:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 20 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.697458:0:5843:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 20 pid: 7920 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.697473:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957212032:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297344.697587:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02fad000 going to sleep for 11 seconds 00000100:00100000:1.0:1789297344.700573:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297344.700637:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933112192 00000100:00100000:2.0:1789297344.700647:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933112192 00010000:00010000:2.0:1789297344.700688:0:5826:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 21 pid: 7920 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297344.700776:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:2.0:1789297344.700788:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02e82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:2353:x1876213933112192:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297344.700806:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297344.700814:0:5826:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 21 pid: 7920 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.700830:0:5826:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 21 pid: 7920 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.700856:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:2.0:1789297344.700861:0:5826:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.700871:0:5826:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.700878:0:5826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.700898:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297344.700970:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02e82850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:2353:x1876213933112192:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 184us (407us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297344.700977:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 87 00010000:00010000:0.0:1789297344.702897:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c331 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc79 expref: 20 pid: 7920 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.703148:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957212032:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297344.703176:0:5843:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.703187:0:5843:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.703193:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789297344.703620:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:0.0:1789297344.704060:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000001:00080000:0.0:1789297344.704111:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:0.0:1789297344.704200:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876213957212160:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789297344.704267:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297344.704415:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4600 going to sleep for 11 seconds 00000100:00100000:2.0:1789297344.704605:0:5847:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957212160 00000100:00100000:2.0:1789297344.704622:0:5847:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957212160 00000100:00100000:2.0:1789297344.704750:0:5847:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789297344.704760:0:5847:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876213957212160:12345-0@lo:1000:mdt00_001.0 00000100:00100000:2.0:1789297344.704845:0:5847:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5843:x1876213957212160:12345-0@lo:1000:mdt00_001.0 Request processed in 87us (577us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297344.704853:0:5847:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1789297344.704977:0:5843:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967321 gen 2 00000004:00080000:0.0:1789297344.704983:0:5843:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967321 00000004:00080000:0.0:1789297344.704999:0:5843:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b38224700, transno 4294967321 00000100:00100000:0.0:1789297344.705016:0:5843:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff982b0621fb80 x1876213957211264/t4294967322(4294967322) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1789297360 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297344.705029:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876213957212160:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1789297344.705445:0:5843:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967512 00000100:00100000:0.0:1789297344.705522:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876213957212288:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1789297344.705557:0:5843:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297344.706501:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02fad000 going to sleep for 11 seconds 00000100:00100000:1.0:1789297344.706859:0:5848:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957212288 00000100:00100000:1.0:1789297344.706869:0:5848:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957212288 00000100:00100000:1.0:1789297344.706921:0:5848:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789297344.707024:0:5848:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5843:x1876213957212288:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1789297344.707298:0:5848:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5843:x1876213957212288:12345-0@lo:1000:mdt00_001.0 Request processed in 368us (1739us total) trans 4294967324 rc 0/0 00000100:00100000:1.0:1789297344.707305:0:5848:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789297344.707750:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40951c00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:5843:1876213957212288:0@lo:1000:mdt00_001.0 00010000:00010000:0.0:1789297344.707804:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707815:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707823:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707829:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bba00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297344.707847:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707855:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707873:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585700) 00010000:00010000:0.0:1789297344.707876:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297344.707880:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707885:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bba00/0x8ad177e823a0c37e lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707920:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707925:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707946:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707951:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152aa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297344.707954:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707960:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707969:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:0.0:1789297344.707972:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297344.707987:0:5843:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.707999:0:5843:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.708009:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.708047:0:5843:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 23 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.708063:0:5843:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38290a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957212416:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789297344.708212:0:5843:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02fad000 going to sleep for 11 seconds 00000100:00100000:3.0:1789297344.711684:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.711908:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933112320 00000100:00100000:1.0:1789297344.711917:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933112320 00000100:00100000:1.0:1789297344.711985:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:1.0:1789297344.711996:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+24:11641:x1876213933112320:12345-192.168.202.43@tcp:49:lfs.0 00000100:00100000:1.0:1789297344.712127:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+24:11641:x1876213933112320:12345-192.168.202.43@tcp:49:lfs.0 Request processed in 133us (455us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.712135:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 61 00000100:00100000:0.0:1789297344.713741:0:5843:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38290a80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5843:1876213957212416:192.168.202.43@tcp:105: 00010000:00010000:0.0:1789297344.713779:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713791:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c2c1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713828:0:5843:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713843:0:5843:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713855:0:5843:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713880:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713886:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713893:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713900:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbc00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297344.713904:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713911:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713924:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:0.0:1789297344.713938:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297344.713943:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713949:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bbc00/0x8ad177e823a0c385 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713960:0:5843:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713966:0:5843:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713972:0:5843:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713985:0:5843:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297344.713988:0:5843:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.713995:0:5843:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.714003:0:5843:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:0.0:1789297344.714005:0:5843:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789297344.714008:0:5843:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.714014:0:5843:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059ba600/0x8ad177e823a0c377 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5843 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.714237:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+23:11642:x1876213933112064:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 17564us (19030us total) trans 4294967513 rc 0/0 00000100:00100000:0.0:1789297344.714248:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 230 00000020:00080000:0.0:1789297344.714253:0:5843:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:1.0:1789297344.718065:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789297344.718076:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789297344.718912:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:1.0:1789297344.718926:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789297344.725404:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297344.725758:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933112576 00000100:00100000:2.0:1789297344.725777:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933112576 00000100:00100000:2.0:1789297344.725844:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:2.0:1789297344.725854:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+23:11641:x1876213933112576:12345-192.168.202.43@tcp:58:lfs.0 00000040:00080000:2.0:1789297344.726517:0:5842:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:2.0:1789297344.726623:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e69500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+23:11641:x1876213933112576:12345-192.168.202.43@tcp:58:lfs.0 Request processed in 769us (1227us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297344.726633:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 231 00000100:00100000:3.0:1789297344.731485:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.731851:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933112832 00000100:00100000:1.0:1789297344.731862:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933112832 00000100:00100000:1.0:1789297344.731967:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 62 00000100:00100000:1.0:1789297344.731980:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b30fce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+23:11642:x1876213933112832:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1789297344.732735:0:5845:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1789297344.732872:0:5845:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967514 00010000:00010000:1.0:1789297344.732921:0:5845:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.732938:0:5845:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.732951:0:5845:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.732959:0:5845:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.732966:0:5845:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.732972:0:5845:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.733000:0:5845:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1789297344.733103:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b30fce850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+25:11642:x1876213933112832:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 1123us (1626us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1789297344.733112:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 62 00000020:00080000:1.0:1789297344.733117:0:5845:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1789297344.733277:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297344.733284:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.733291:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297344.733295:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.733303:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.733317:0:5829:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff982b08585100) 00010000:00010000:2.0:1789297344.733320:0:5829:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1789297344.733326:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.733343:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2600/0x8ad177e823a0c38c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5845 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297344.733360:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297344.733362:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297344.733364:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297344.766396:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297344.766521:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933112960 00000100:00100000:3.0:1789297344.766531:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933112960 00000100:00100000:3.0:1789297344.766588:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 232 00000100:00100000:3.0:1789297344.766597:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+25:11644:x1876213933112960:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297344.766621:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297344.766641:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c393 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc95 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.766738:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.766753:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.766774:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.766788:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.766795:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.766816:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.767679:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.767696:0:5844:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.767725:0:5844:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.767761:0:5844:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297344.767786:0:5844:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 26 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297344.767801:0:5844:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957212544:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297344.767973:0:5844:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b12fb7a80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297344.776867:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.777383:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933113216 00000100:00100000:1.0:1789297344.777393:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933113216 00000100:00100000:1.0:1789297344.777453:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:1.0:1789297344.777463:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+27:5595:x1876213933113216:12345-192.168.202.43@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1789297344.777929:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38290a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+28:5595:x1876213933113216:12345-192.168.202.43@tcp:35:ldlm_bl.0 Request processed in 465us (1069us total) trans 4294967516 rc 0/0 00000100:00100000:1.0:1789297344.777958:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 63 00000100:00100000:3.0:1789297344.778248:0:5844:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b40943b80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5844:1876213957212544:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297344.778275:0:5844:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297344.780859:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297344.781024:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933113344 00000100:00100000:1.0:1789297344.781035:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933113344 00010000:00010000:1.0:1789297344.781133:0:5828:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 28 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297344.781237:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:1.0:1789297344.781246:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+28:2353:x1876213933113344:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297344.781259:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297344.781265:0:5828:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 28 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.781274:0:5828:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 28 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.781293:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c2b3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc56 expref: 28 pid: 5844 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.781305:0:5828:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297344.781308:0:5828:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.781314:0:5828:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.781319:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297344.781356:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297344.781408:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277dc380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:235dd3df-f928-4719-bb69-fc817cc2744f+27:2353:x1876213933113344:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 163us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297344.781413:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 88 00010000:00010000:0.0:1789297344.782307:0:5844:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782316:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297344.782354:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:0.0:1789297344.782357:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297344.782421:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782443:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782450:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782455:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782460:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782464:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297344.782466:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782471:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782480:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:0.0:1789297344.782482:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297344.782485:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782632:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c39a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782648:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782654:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782666:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782671:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152be00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297344.782674:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782681:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782689:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff982b03073d00) 00010000:00010000:0.0:1789297344.782692:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297344.782695:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782699:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152be00/0x8ad177e823a0c3a1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782761:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c393 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc95 expref: 27 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782782:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc95 expref: 26 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297344.782787:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:0.0:1789297344.782789:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297344.782790:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152aa00, rc 0) 00000100:00100000:0.0:1789297344.782838:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11e68e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+26:11644:x1876213933112960:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 16242us (16452us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297344.782855:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 232 00010000:00010000:1.0:1789297345.020894:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297345.469078:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957212672:0@lo:400:kworker.0 00000100:00100000:2.0:1789297345.469152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297345.469265:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957212672 00000100:00100000:0.0:1789297345.469274:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957212672 00000100:00100000:0.0:1789297345.469348:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:0.0:1789297345.469374:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957212672:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297345.472871:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957212672:12345-0@lo:400:kworker.0 Request processed in 3506us (3710us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297345.472887:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1789297345.472896:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957212800:0@lo:400:kworker.0 00000100:00100000:1.0:1789297345.472961:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297345.473000:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957213312:0@lo:400:kworker.0 00000100:00100000:0.0:1789297345.473019:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957212800 00000100:00100000:0.0:1789297345.473029:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957212800 00000100:00100000:1.0:1789297345.473033:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297345.473063:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297345.473072:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957212928:0@lo:400:kworker.0 00000100:00100000:0.0:1789297345.473079:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1789297345.473090:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957212800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297345.473099:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297345.473137:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957213312 00000100:00100000:1.0:1789297345.473142:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957213312 00000100:00100000:0.0:1789297345.473152:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957212800:12345-0@lo:400:kworker.0 Request processed in 63us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297345.473160:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:1.0:1789297345.473177:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789297345.473178:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957212928 00000100:00100000:0.0:1789297345.473183:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957212928 00000100:00100000:1.0:1789297345.473187:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957213312:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297345.473225:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789297345.473229:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957213312:12345-0@lo:400:kworker.0 Request processed in 43us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297345.473236:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957212928:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297345.473242:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1789297345.473274:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957212928:12345-0@lo:400:kworker.0 Request processed in 41us (174us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297345.473280:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1789297345.473291:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957212928:0@lo:400:kworker.0 00000100:00100000:1.0:1789297345.473304:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957212800:0@lo:400:kworker.0 00000100:00100000:1.0:1789297345.473315:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11fcdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957213312:0@lo:400:kworker.0 00000100:00100000:2.0:1789297345.474423:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957212672:0@lo:400:kworker.0 00000100:00080000:2.0:1789297345.474451:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297345.474465:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957213056:0@lo:400:kworker.0 00000100:00100000:2.0:1789297345.474505:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297345.474607:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957213056 00000100:00100000:0.0:1789297345.474613:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957213056 00000100:00100000:0.0:1789297345.474648:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:0.0:1789297345.474655:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876213957213056:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297345.477029:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957213184:0@lo:400:kworker.0 00000100:00100000:0.0:1789297345.477233:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3304:x1876213957213056:12345-0@lo:400:kworker.0 Request processed in 2575us (2724us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297345.477243:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1789297345.483858:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957213056:0@lo:400:kworker.0 00000100:00100000:3.0:1789297345.489383:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297345.489494:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957213184 00000100:00100000:1.0:1789297345.489503:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957213184 00000100:00100000:1.0:1789297345.489576:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1789297345.489585:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957213184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297345.489646:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40943b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957213184:12345-0@lo:400:kworker.0 Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297345.489653:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00080000:3.0:1789297345.489731:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297345.489782:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b11f54e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957213184:0@lo:400:kworker.0 00000040:00080000:2.0:1789297345.575025:0:12575:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297345.575036:0:12575:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297345.575100:0:12575:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789297345.575106:0:12575:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1789297345.726448:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297345.726461:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297345.726535:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1789297345.726543:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1789297345.726665:0:11697:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38227480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957213440:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789297345.726809:0:11697:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3240 going to sleep for 11 seconds 00000100:00100000:3.0:1789297345.732886:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297345.733090:0:11697:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38227480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11697:1876213957213440:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789297345.733339:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933113472 00000100:00100000:1.0:1789297345.733348:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933113472 00000100:00100000:1.0:1789297345.733439:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:1.0:1789297345.733451:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+26:11656:x1876213933113472:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000100:00080000:3.0:1789297345.733643:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00000080:1.0:1789297345.733677:0:5843:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1789297345.733811:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:235dd3df-f928-4719-bb69-fc817cc2744f+26:11656:x1876213933113472:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 362us (934us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297345.733820:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 233 00000100:00100000:1.0:1789297345.736429:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297345.736509:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933113728 00000100:00100000:2.0:1789297345.736534:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933113728 00000100:00100000:2.0:1789297345.736593:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 234 00000100:00100000:2.0:1789297345.736605:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+26:11656:x1876213933113728:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297345.736625:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297345.736646:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c3af lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dc9c expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.736796:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c3b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.736810:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.736825:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c3b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297345.736837:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1789297345.736960:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c3af lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc9c expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.736977:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c3b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc9c expref: 28 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.736986:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297345.736989:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297345.736993:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257c00, rc 0) 00000100:00100000:2.0:1789297345.737046:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+28:11656:x1876213933113728:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 444us (627us total) trans 4294967517 rc 0/0 00000100:00100000:2.0:1789297345.737054:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 234 00000100:00100000:2.0:1789297345.741176:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297345.741303:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297345.741335:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933114112 00000100:00100000:2.0:1789297345.741344:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933114112 00000100:00100000:2.0:1789297345.741409:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 235 00000100:00100000:2.0:1789297345.741420:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+28:11656:x1876213933114112:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1789297345.741516:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741535:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741548:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741808:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741816:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741823:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741831:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297345.741835:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741844:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741859:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297345.741874:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1789297345.741879:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297345.741886:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c3c4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297345.742053:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+29:11656:x1876213933114112:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 633us (748us total) trans 4294967518 rc 0/0 00000100:00100000:2.0:1789297345.742061:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 235 00000040:00080000:2.0:1789297345.742249:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1789297345.742254:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297345.742777:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:2.0:1789297345.742787:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1789297345.742911:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933113856 00000100:00100000:1.0:1789297345.742920:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933113856 00000100:00100000:1.0:1789297345.742976:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:1.0:1789297345.742986:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+29:2355:x1876213933113856:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297345.743001:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297345.743020:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c3b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc9c expref: 29 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297345.743034:0:5826:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297345.743038:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297345.743075:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:235dd3df-f928-4719-bb69-fc817cc2744f+28:2355:x1876213933113856:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 90us (1911us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297345.743096:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:1.0:1789297345.747899:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297345.748137:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933114368 00000100:00100000:0.0:1789297345.748148:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933114368 00000100:00100000:0.0:1789297345.748323:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:0.0:1789297345.748334:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+28:11656:x1876213933114368:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789297345.749795:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+29:11656:x1876213933114368:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 1454us (1900us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1789297345.749808:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 64 00000100:00100000:2.0:1789297345.981013:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957213568:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297345.981132:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297345.987584:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957213568 00000100:00100000:1.0:1789297345.987602:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957213568 00000100:00100000:1.0:1789297345.989019:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:1.0:1789297345.989041:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957213568:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297345.989365:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3856662528 00000100:00100000:1.0:1789297345.989458:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3303:x1876213957213568:12345-0@lo:13:osp-pre-1-0.0 Request processed in 428us (8325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297345.989465:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789297345.989566:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957213568:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297346.045393:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297346.492999:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297346.493028:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957213696:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297346.493110:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297346.493447:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957213696 00000100:00100000:0.0:1789297346.493457:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957213696 00000100:00100000:0.0:1789297346.493525:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:0.0:1789297346.493534:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957213696:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297346.493576:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297346.493641:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11f54e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3305:x1876213957213696:12345-0@lo:13:osp-pre-0-0.0 Request processed in 107us (530us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297346.493648:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1789297346.493769:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38698380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957213696:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789297346.493839:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789297347.068901:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297347.327248:0:12627:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1789297347.327258:0:12627:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1789297347.327319:0:12627:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1789297347.327324:0:12627:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1789297347.524772:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297347.524887:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933114624 00000100:00100000:2.0:1789297347.524897:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933114624 00000100:00100000:2.0:1789297347.524962:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 236 00000100:00100000:2.0:1789297347.524973:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b277ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+29:11677:x1876213933114624:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297347.524998:0:5842:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297347.525016:0:5842:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c3cb lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dca3 expref: -99 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297347.525103:0:5842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0c3d2 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297347.525122:0:5842:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0c3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297347.525136:0:5842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0c3d2 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5842 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297347.525147:0:5842:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000100:00080000:0.0:1789297347.525237:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789297347.529268:0:5842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256600/0x8ad177e823a0c3cb lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dca3 expref: 32 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297347.529292:0:5842:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0c3d2 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dca3 expref: 31 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297347.529301:0:5842:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297347.529304:0:5842:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789297347.529307:0:5842:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256c00, rc 0) 00000100:00100000:2.0:1789297347.529378:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b277ddc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+31:11677:x1876213933114624:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 4407us (4617us total) trans 4294967520 rc 0/0 00000100:00100000:2.0:1789297347.529387:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 236 00000100:00100000:2.0:1789297347.546006:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297347.546204:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933114752 00000100:00100000:1.0:1789297347.546216:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933114752 00000100:00100000:1.0:1789297347.546275:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 237 00000100:00100000:1.0:1789297347.546286:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+31:11677:x1876213933114752:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:1.0:1789297347.546370:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546388:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546399:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546454:0:5844:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546466:0:5844:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546473:0:5844:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546478:0:5844:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297347.546483:0:5844:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546492:0:5844:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546503:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:1.0:1789297347.546506:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1789297347.546510:0:5844:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297347.546516:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b382b2400/0x8ad177e823a0c3e0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297347.546597:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:235dd3df-f928-4719-bb69-fc817cc2744f+31:11677:x1876213933114752:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 312us (600us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297347.546604:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 237 00000100:00100000:1.0:1789297347.636621:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297347.636766:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933114880 00000100:00100000:0.0:1789297347.636777:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933114880 00000100:00100000:0.0:1789297347.636843:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00100000:0.0:1789297347.636855:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+7:2353:x1876213933114880:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:0.0:1789297347.636874:0:6689:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297347.636894:0:6689:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000305e344f/0x8ad177e823a0c3e7 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dcaa expref: -99 pid: 6689 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789297347.636937:0:6689:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6aa682bf, atime: 0x6aa682bf, ctime: 0x6aa682bf, blocks: 0xb 00010000:00010000:0.0:1789297347.636958:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1789297347.636962:0:6689:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297347.636972:0:6689:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000305e344f/0x8ad177e823a0c3e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcaa expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297347.636991:0:6689:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000305e344f/0x8ad177e823a0c3e7 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcaa expref: 8 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297347.637003:0:6689:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059ba200, rc 0) 00000100:00100000:0.0:1789297347.637059:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38698380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2353:x1876213933114880:12345-192.168.202.43@tcp:101:cat.0 Request processed in 207us (447us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297347.637066:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 72 00000100:00080000:3.0:1789297347.637234:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297347.640933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297347.641061:0:6694:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933115008 00000100:00100000:0.0:1789297347.641074:0:6694:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933115008 00002000:00100000:0.0:1789297347.641130:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff982b11fcdf80 x1876213933115008/t0(0) o3->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:208/0 lens 488/0 e 0 to 0 dl 1789297358 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789297347.641141:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b11fcdf80 with x1876213933115008 ext(0->4095) 00002000:00010000:0.0:1789297347.641147:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b11fcdf80 00000100:00100000:0.0:1789297347.641298:0:6694:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:0.0:1789297347.641308:0:6694:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b11fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933115008:12345-192.168.202.43@tcp:3:cat.0 00000100:00100000:0.0:1789297347.641670:0:6694:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b11fcdf80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:235dd3df-f928-4719-bb69-fc817cc2744f+8:2354:x1876213933115008:12345-192.168.202.43@tcp:3:cat.0 Request processed in 361us (746us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1789297347.641696:0:6694:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00002000:00100000:0.0:1789297347.641751:0:6694:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff982b11fcdf80 x1876213933115008/t0(0) o3->235dd3df-f928-4719-bb69-fc817cc2744f@192.168.202.43@tcp:208/0 lens 488/4536 e 0 to 0 dl 1789297358 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1789297347.641759:0:6694:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff982b11fcdf80 with x1876213933115008 ext(0->4095) 00002000:00010000:0.0:1789297347.641762:0:6694:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff982b11fcdf80 00000100:00100000:2.0:1789297348.078976:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297348.079028:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297348.079072:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297348.079244:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933115264 00000100:00100000:0.0:1789297348.079255:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933115264 00000100:00100000:0.0:1789297348.079335:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:0.0:1789297348.079357:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2356:x1876213933115264:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297348.079447:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2356:x1876213933115264:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 92us (373us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297348.079455:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:3.0:1789297348.080229:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933115392 00000100:00100000:3.0:1789297348.080238:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933115392 00000100:00100000:3.0:1789297348.080311:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 155 00000100:00100000:3.0:1789297348.080322:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2356:x1876213933115392:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297348.080390:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2356:x1876213933115392:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 70us (1361us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297348.080398:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 155 00000100:00080000:2.0:1789297348.080578:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789297348.080583:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297348.081087:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933115136 00000100:00100000:1.0:1789297348.081109:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933115136 00000100:00100000:1.0:1789297348.081160:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 296 00000100:00100000:1.0:1789297348.081171:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933115136:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297348.081234:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933115136:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 66us (2273us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297348.081242:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 296 00010000:00010000:1.0:1789297348.094066:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297349.117007:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1789297349.168016:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00010000:00010000:0.0:1789297350.143496:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789297350.160410:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:2.0:1789297350.160427:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1789297350.170599:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:2.0:1789297350.170623:0:5864:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff982b051e4840 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:2.0:1789297350.170629:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b38212900 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff982b051e4600 00000020:00080000:2.0:1789297350.170632:0:5864:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff982b38212c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff982a01534000 00000020:00080000:2.0:1789297350.170661:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1789297350.170677:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000001:00080000:2.0:1789297350.170684:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1789297350.170940:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:1.0:1789297350.592252:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957213952:0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.592344:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297350.592402:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957214464:0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.592428:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297350.592472:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297350.592478:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957214080:0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.592500:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297350.592536:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957213952 00000100:00100000:1.0:1789297350.592543:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957213952 00000100:00100000:1.0:1789297350.592586:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214080 00000100:00100000:1.0:1789297350.592591:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214080 00000100:00100000:1.0:1789297350.592621:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789297350.592629:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957213952:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.592676:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957213952:12345-0@lo:400:kworker.0 Request processed in 47us (332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297350.592683:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1789297350.592734:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789297350.592742:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957214080:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.592788:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957214080:12345-0@lo:400:kworker.0 Request processed in 47us (286us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297350.592794:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1789297350.592810:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214464 00000100:00100000:1.0:1789297350.592813:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214464 00000100:00100000:1.0:1789297350.592839:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1789297350.592845:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957214464:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.592873:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957214464:12345-0@lo:400:kworker.0 Request processed in 28us (443us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297350.592878:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:1.0:1789297350.593118:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789297350.593123:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297350.593160:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957214080:0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.593170:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957213952:0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.593177:0:3302:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1789297350.593183:0:3302:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b0621fb80, transno 4294967322 00000004:00080000:1.0:1789297350.593193:0:3302:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967324 committed transno 4294967324 00000100:00100000:3.0:1789297350.593315:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957213824:0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.593355:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297350.593381:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957214336:0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.593418:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297350.593447:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297350.593453:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957214208:0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.593475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297350.593510:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957213824 00000100:00100000:3.0:1789297350.593515:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957213824 00000100:00100000:3.0:1789297350.593542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789297350.593548:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957213824:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.593589:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957213824:12345-0@lo:400:kworker.0 Request processed in 41us (233us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297350.593594:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:3.0:1789297350.593617:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214208 00000100:00100000:3.0:1789297350.593621:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214208 00000100:00100000:3.0:1789297350.593650:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:3.0:1789297350.593657:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957214208:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.593687:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957214208:12345-0@lo:400:kworker.0 Request processed in 31us (210us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297350.593693:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00080000:3.0:1789297350.593744:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297350.593760:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:3.0:1789297350.593764:0:3305:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b40941880, transno 4294967310 00000100:00100000:3.0:1789297350.593774:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957214208:0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.593784:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957213824:0@lo:400:kworker.0 00000100:00100000:1.0:1789297350.594397:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957214464:0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.594497:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214336 00000100:00100000:3.0:1789297350.594503:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214336 00000100:00100000:3.0:1789297350.594541:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1789297350.594547:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957214336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297350.594589:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957214336:12345-0@lo:400:kworker.0 Request processed in 41us (1169us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297350.594595:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:3.0:1789297350.594611:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297350.594634:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957214336:0@lo:400:kworker.0 00000100:00100000:2.0:1789297351.102474:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957214592:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297351.102555:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297351.104361:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214592 00000100:00100000:0.0:1789297351.104375:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214592 00000100:00100000:0.0:1789297351.104612:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1789297351.104625:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957214592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297351.104672:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297351.104803:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957214592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 181us (2248us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297351.104811:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1789297351.104901:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957214592:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1789297351.165795:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297351.615835:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297351.615875:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957214720:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297351.615947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297351.616088:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214720 00000100:00100000:1.0:1789297351.616097:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214720 00000100:00100000:1.0:1789297351.616154:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1789297351.616164:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957214720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297351.616200:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297351.616261:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957214720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297351.616278:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1789297351.616497:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957214720:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1789297352.192782:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297352.458101:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297352.458202:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933115520 00000100:00100000:1.0:1789297352.458213:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933115520 00000100:00100000:1.0:1789297352.458295:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 238 00000100:00100000:1.0:1789297352.458306:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+18:11330:x1876213933115520:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1789297352.458458:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a024bd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+18:11330:x1876213933115520:12345-192.168.202.43@tcp:60:lhsmtool_posix.0 Request processed in 153us (366us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297352.458467:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 238 00000100:00080000:3.0:1789297352.458541:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297352.465363:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297352.465455:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933115776 00000100:00100000:0.0:1789297352.465475:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933115776 00000100:00100000:0.0:1789297352.465535:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:0.0:1789297352.465547:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:11330:x1876213933115776:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1789297352.465914:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+19:11330:x1876213933115776:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 370us (562us total) trans 4294967521 rc 0/0 00000100:00100000:0.0:1789297352.465920:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 65 00000100:00100000:2.0:1789297352.743263:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297352.743390:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933115904 00000100:00100000:3.0:1789297352.743401:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933115904 00000100:00080000:0.0:1789297352.743555:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297352.743634:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 239 00000100:00100000:3.0:1789297352.743657:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:12129:x1876213933115904:12345-192.168.202.43@tcp:101:lsof.0 00010000:00010000:3.0:1789297352.743682:0:5844:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297352.743741:0:5844:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c3ee lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dcb1 expref: -99 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297352.743819:0:5844:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c3f5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297352.743834:0:5844:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297352.743848:0:5844:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297352.743887:0:5844:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789297352.743890:0:5844:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297352.743913:0:5844:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c3f5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5844 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297352.743936:0:5844:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e000/0x8ad177e823a0c3ee lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcb1 expref: 7 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297352.743976:0:5844:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c3f5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcb1 expref: 6 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297352.743985:0:5844:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:3.0:1789297352.743987:0:5844:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297352.743991:0:5844:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e400, rc 0) 00000100:00100000:3.0:1789297352.744061:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:12129:x1876213933115904:12345-192.168.202.43@tcp:101:lsof.0 Request processed in 408us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297352.744068:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 239 00000040:00080000:0.0:1789297352.893016:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789297352.893024:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789297352.893050:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:0.0:1789297352.893055:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1789297353.195881:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297353.195929:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297353.195966:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297353.196002:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297353.196040:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297353.196068:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116288 00000100:00100000:3.0:1789297353.196080:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116288 00000100:00100000:3.0:1789297353.196150:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116416 00000100:00100000:3.0:1789297353.196154:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116416 00000100:00100000:3.0:1789297353.196183:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:3.0:1789297353.196197:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2355:x1876213933116288:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297353.196283:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+5:2355:x1876213933116288:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 91us (353us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297353.196290:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:2.0:1789297353.196291:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116032 00000100:00100000:2.0:1789297353.196295:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116032 00000100:00100000:3.0:1789297353.196306:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:3.0:1789297353.196312:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933116416:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297353.196324:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 298 00000100:00100000:2.0:1789297353.196329:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933116032:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297353.196355:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933116032:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 26us (489us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297353.196361:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 298 00000100:00100000:1.0:1789297353.196424:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116544 00000100:00100000:1.0:1789297353.196429:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116544 00000100:00100000:0.0:1789297353.196475:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116160 00000100:00100000:0.0:1789297353.196479:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116160 00000100:00100000:0.0:1789297353.196512:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 159 00000100:00100000:0.0:1789297353.196519:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+19:2355:x1876213933116160:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297353.196589:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 160 00000100:00100000:1.0:1789297353.196596:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2355:x1876213933116544:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297353.196640:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:235dd3df-f928-4719-bb69-fc817cc2744f+7:2355:x1876213933116416:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 327us (599us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297353.196649:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00080000:3.0:1789297353.196683:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1789297353.196699:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789297353.200514:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:235dd3df-f928-4719-bb69-fc817cc2744f+19:2355:x1876213933116160:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 3980us (4495us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297353.200545:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 159 00000100:00100000:1.0:1789297353.200877:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2355:x1876213933116544:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 4278us (4907us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297353.200886:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 160 00010000:00010000:0.0:1789297353.214849:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297354.237008:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1789297355.237287:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967521 is committed 00000020:00080000:2.0:1789297355.237306:0:5864:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:0.0:1789297355.237403:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:0.0:1789297355.237412:0:5875:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00010000:00010000:2.0:1789297355.260940:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297355.709077:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957215104:0@lo:400:kworker.0 00000100:00100000:1.0:1789297355.709146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297355.709220:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:1.0:1789297355.709227:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957214976:0@lo:400:kworker.0 00000100:00100000:1.0:1789297355.709264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297355.709280:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957215488:0@lo:400:kworker.0 00000100:00100000:1.0:1789297355.709299:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297355.709328:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957215488 00000100:00100000:1.0:1789297355.709335:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957215488 00000100:00100000:0.0:1789297355.709372:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957215104 00000100:00100000:0.0:1789297355.709379:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957215104 00000100:00100000:1.0:1789297355.709400:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:1.0:1789297355.709407:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957215488:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297355.709418:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214976 00000100:00100000:0.0:1789297355.709423:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214976 00000100:00100000:0.0:1789297355.709458:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789297355.709459:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39c84700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957215488:12345-0@lo:400:kworker.0 Request processed in 51us (157us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297355.709467:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1789297355.709472:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957215104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297355.709504:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ef7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957215488:0@lo:400:kworker.0 00000100:00100000:0.0:1789297355.709530:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ef6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957215104:12345-0@lo:400:kworker.0 Request processed in 61us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297355.709531:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957215104:0@lo:400:kworker.0 00000100:00100000:0.0:1789297355.709543:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1789297355.709563:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1789297355.709613:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957214848:0@lo:400:kworker.0 00000100:00100000:3.0:1789297355.709640:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297355.709658:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957215360:0@lo:400:kworker.0 00000100:00100000:3.0:1789297355.709741:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297355.709762:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297355.709766:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957215232:0@lo:400:kworker.0 00000100:00100000:3.0:1789297355.709781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297355.709804:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957215360 00000100:00100000:3.0:1789297355.709807:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957215360 00000100:00100000:1.0:1789297355.709902:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957214976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297355.709931:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40951c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957214976:12345-0@lo:400:kworker.0 Request processed in 362us (666us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297355.711604:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957214976:0@lo:400:kworker.0 00000100:00100000:2.0:1789297355.712471:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957214848 00000100:00100000:2.0:1789297355.712479:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957214848 00000100:00100000:2.0:1789297355.712520:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:2.0:1789297355.712527:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957214848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297355.712603:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957214848:12345-0@lo:400:kworker.0 Request processed in 77us (2962us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297355.712620:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00080000:2.0:1789297355.712649:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789297355.712654:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789297355.712700:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957215232 00000100:00100000:2.0:1789297355.712721:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957215232 00000100:00100000:2.0:1789297355.712762:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:2.0:1789297355.712767:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957215232:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297355.712796:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957215232:12345-0@lo:400:kworker.0 Request processed in 29us (3014us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297355.712800:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00080000:2.0:1789297355.712810:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789297355.712835:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957215232:0@lo:400:kworker.0 00000100:00100000:2.0:1789297355.712842:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957214848:0@lo:400:kworker.0 00000100:00100000:3.0:1789297355.713850:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:3.0:1789297355.713862:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957215360:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297355.713977:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957215360:12345-0@lo:400:kworker.0 Request processed in 119us (4234us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297355.713984:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1789297355.714865:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957215360:0@lo:400:kworker.0 00000100:00100000:1.0:1789297355.715476:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000001:02000400:3.0:1789297356.134746:0:12828:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 07:02:35 (1789297355) 00000100:00100000:0.0:1789297356.225079:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957215616:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297356.225164:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297356.225240:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957215616 00000100:00100000:1.0:1789297356.225248:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957215616 00000100:00100000:1.0:1789297356.225313:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1789297356.225324:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957215616:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1789297356.225361:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297356.225422:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957215616:12345-0@lo:13:osp-pre-1-0.0 Request processed in 99us (258us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297356.225430:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:0.0:1789297356.225749:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957215616:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789297356.288289:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297356.733156:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957215744:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297356.733227:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297356.733335:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957215744 00000100:00100000:0.0:1789297356.733343:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957215744 00000100:00100000:0.0:1789297356.733400:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1789297356.733409:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957215744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297356.733449:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297356.733500:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957215744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 91us (273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297356.733507:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1789297356.733729:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957215744:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1789297357.309486:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297358.316162:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297358.316208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297358.316256:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297358.316284:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297358.316340:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297358.316403:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933117184 00000100:00100000:0.0:1789297358.316403:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116800 00000100:00100000:0.0:1789297358.316414:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116800 00000100:00100000:0.0:1789297358.316479:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:0.0:1789297358.316490:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:2356:x1876213933116800:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297358.316571:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+18:2356:x1876213933116800:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 83us (285us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297358.316579:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 164 00000100:00100000:3.0:1789297358.316803:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933117184 00000100:00100000:3.0:1789297358.316838:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:3.0:1789297358.316846:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2356:x1876213933117184:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297358.316874:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2356:x1876213933117184:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (629us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297358.316880:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 165 00000100:00100000:3.0:1789297358.316901:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116928 00000100:00100000:3.0:1789297358.316905:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116928 00000100:00100000:3.0:1789297358.316930:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933117056 00000100:00100000:3.0:1789297358.316933:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933117056 00000100:00100000:3.0:1789297358.316952:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:3.0:1789297358.316958:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2356:x1876213933116928:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297358.316984:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2356:x1876213933116928:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (776us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297358.316991:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:3.0:1789297358.317003:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:3.0:1789297358.317008:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2356:x1876213933117056:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297358.317032:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2356:x1876213933117056:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (692us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297358.317037:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:2.0:1789297358.317169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933116672 00000100:00100000:2.0:1789297358.317174:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933116672 00000100:00100000:2.0:1789297358.317217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 300 00000100:00100000:2.0:1789297358.317224:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933116672:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297358.317263:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2356:x1876213933116672:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 40us (1113us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297358.317281:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 300 00000100:00080000:2.0:1789297358.317322:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297358.317327:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789297358.317329:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1789297358.335343:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297359.356950:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297360.381291:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297360.782489:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297360.782637:0:5846:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933117440 00000100:00100000:1.0:1789297360.782649:0:5846:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933117440 00000100:00100000:1.0:1789297360.782747:0:5846:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:1.0:1789297360.782757:0:5846:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+18:12350:x1876213933117440:12345-192.168.202.43@tcp:35:umount.0 00000100:00080000:2.0:1789297360.782873:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297360.783499:0:5846:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:235dd3df-f928-4719-bb69-fc817cc2744f+19:12350:x1876213933117440:12345-192.168.202.43@tcp:35:umount.0 Request processed in 741us (1031us total) trans 4294967522 rc 0/0 00000100:00100000:1.0:1789297360.783508:0:5846:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 66 00000100:00100000:0.0:1789297360.790814:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297360.790943:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933117696 00000100:00100000:1.0:1789297360.790954:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933117696 00000100:00100000:1.0:1789297360.791005:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:1.0:1789297360.791013:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+19:12350:x1876213933117696:12345-192.168.202.43@tcp:35:umount.0 00000100:00100000:1.0:1789297360.791368:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+20:12350:x1876213933117696:12345-192.168.202.43@tcp:35:umount.0 Request processed in 354us (571us total) trans 4294967523 rc 0/0 00000100:00100000:1.0:1789297360.791376:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 67 00000100:00100000:3.0:1789297360.798356:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297360.801246:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933117952 00000100:00100000:1.0:1789297360.801268:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933117952 00000100:00100000:1.0:1789297360.801358:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:1.0:1789297360.801371:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b30fcc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+20:12350:x1876213933117952:12345-192.168.202.43@tcp:35:umount.0 00000100:00100000:1.0:1789297360.801654:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b30fcc450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:12350:x1876213933117952:12345-192.168.202.43@tcp:35:umount.0 Request processed in 284us (3307us total) trans 4294967524 rc 0/0 00000100:00100000:1.0:1789297360.801662:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 68 00000100:00100000:2.0:1789297360.807406:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297360.807934:0:5845:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933118208 00000100:00100000:1.0:1789297360.807947:0:5845:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933118208 00000100:00100000:1.0:1789297360.808018:0:5845:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:1.0:1789297360.808030:0:5845:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+21:12350:x1876213933118208:12345-192.168.202.43@tcp:35:umount.0 00000100:00100000:1.0:1789297360.808694:0:5845:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:235dd3df-f928-4719-bb69-fc817cc2744f+22:12350:x1876213933118208:12345-192.168.202.43@tcp:35:umount.0 Request processed in 664us (1298us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1789297360.812459:0:5845:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 69 00000100:00100000:2.0:1789297360.817699:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297360.817756:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297360.817934:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297360.817974:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933118848 00000100:00100000:2.0:1789297360.817985:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933118848 00000100:00100000:2.0:1789297360.818064:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 73 00000100:00100000:2.0:1789297360.818082:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+7:2352:x1876213933118848:12345-192.168.202.43@tcp:9:umount.0 00000020:00000080:2.0:1789297360.818115:0:11700:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b9ad 00000020:00010000:2.0:1789297360.818123:0:11700:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982b39c17800: total 0 00000100:00080000:2.0:1789297360.818127:0:11700:0:(import.c:65:import_set_state_nolock()) ffff982b39c10000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1789297360.818163:0:11700:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1789297360.818565:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:235dd3df-f928-4719-bb69-fc817cc2744f+5:2352:x1876213933118848:12345-192.168.202.43@tcp:9:umount.0 Request processed in 490us (628us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297360.818573:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 73 00000020:00010000:2.0:1789297360.818599:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982b39c17800: total 0 00010000:00010000:2.0:1789297360.818632:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982b39c17800, canceled 0 locks, left on hash table 2. 00010000:00010000:2.0:1789297360.818693:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000305e344f/0x8ad177e823a0c3e7 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcaa expref: 4 pid: 6689 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.818777:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0bd49 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dadc expref: 3 pid: 11700 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.818793:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982b39c17800, canceled 2 locks, left on hash table 0. 00010000:00010000:2.0:1789297360.818808:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297360.818810:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297360.818811:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1789297360.818820:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789297360.821676:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933118336 00000100:00100000:3.0:1789297360.821697:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933118336 00000100:00100000:3.0:1789297360.821989:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933118464 00000100:00100000:3.0:1789297360.821994:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933118464 00000100:00100000:3.0:1789297360.822054:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:3.0:1789297360.822065:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+14:2355:x1876213933118336:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297360.822081:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297360.822101:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059bb800/0x8ad177e823a0b46d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d83c expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297360.822118:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297360.822189:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+13:2355:x1876213933118336:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 126us (4502us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297360.822197:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:3.0:1789297360.822234:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:3.0:1789297360.822241:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:2355:x1876213933118464:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297360.822252:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297360.822262:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b2a00/0x8ad177e823a0b681 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d907 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297360.822271:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297360.822291:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:2355:x1876213933118464:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 51us (4535us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297360.822310:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:2.0:1789297360.823003:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297360.824939:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933118976 00000100:00100000:3.0:1789297360.824954:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933118976 00000100:00100000:2.0:1789297360.827126:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789297360.827145:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:2355:x1876213933118976:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297360.827167:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297360.827191:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031a00/0x8ad177e823a0b3d3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d804 expref: 11 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.827222:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297360.827970:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933118976:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 829us (4968us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297360.827981:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:3.0:1789297360.828383:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297360.828528:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933119104 00000100:00100000:3.0:1789297360.828548:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933119104 00000100:00100000:3.0:1789297360.828597:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:3.0:1789297360.828605:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+5:2352:x1876213933119104:12345-192.168.202.43@tcp:9:umount.0 00000100:00080000:0.0:1789297360.828755:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000020:00000080:3.0:1789297360.829218:0:6687:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b745 00000100:00080000:3.0:1789297360.829229:0:6687:0:(import.c:65:import_set_state_nolock()) ffff982b03397800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789297360.829269:0:6687:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:0.0:1789297360.829298:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297360.829944:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:235dd3df-f928-4719-bb69-fc817cc2744f+2:2352:x1876213933119104:12345-192.168.202.43@tcp:9:umount.0 Request processed in 1337us (1569us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297360.830157:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 74 00000100:00100000:1.0:1789297360.833906:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957215872:0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.833994:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297360.834084:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957215872 00000100:00100000:1.0:1789297360.834092:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957215872 00000100:00100000:1.0:1789297360.834147:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:1.0:1789297360.834157:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957215872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.834212:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957215872:12345-0@lo:400:kworker.0 Request processed in 56us (218us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297360.834236:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:0.0:1789297360.834258:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297360.834834:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957215872:0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.834877:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297360.834887:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957216128:0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.834923:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297360.834963:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216128 00000100:00100000:1.0:1789297360.834967:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216128 00000100:00100000:1.0:1789297360.835007:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789297360.835015:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957216128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.835064:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957216128:12345-0@lo:400:kworker.0 Request processed in 50us (140us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297360.835071:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1789297360.835104:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957216128:0@lo:400:kworker.0 00000100:00080000:1.0:1789297360.835127:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297360.840724:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957216000:0@lo:400:kworker.0 00000100:00100000:0.0:1789297360.840827:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297360.841138:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216000 00000100:00100000:3.0:1789297360.841149:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216000 00000100:00100000:3.0:1789297360.841235:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1789297360.841246:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957216000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297360.841935:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b2021d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957216000:12345-0@lo:400:kworker.0 Request processed in 689us (1105us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297360.841945:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:0.0:1789297360.844857:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297360.844998:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933120128 00000100:00100000:3.0:1789297360.845012:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933120128 00000100:00100000:3.0:1789297360.845145:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 240 00000100:00100000:3.0:1789297360.845159:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+22:2352:x1876213933120128:12345-192.168.202.43@tcp:39:umount.0 00000020:00000080:3.0:1789297360.845199:0:5842:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b3e1 00000020:00010000:3.0:1789297360.845233:0:5842:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982b39cbe000: total 0 00000100:00080000:3.0:1789297360.845239:0:5842:0:(import.c:65:import_set_state_nolock()) ffff982b39cb9000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1789297360.845266:0:5842:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:0.0:1789297360.846629:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957216256:0@lo:400:kworker.0 00000100:00100000:0.0:1789297360.846725:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297360.846772:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297360.846779:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957216384:0@lo:400:kworker.0 00000100:00100000:0.0:1789297360.847122:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297360.847162:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216384 00000100:00100000:0.0:1789297360.847169:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216384 00000100:00100000:0.0:1789297360.847246:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 168 00000100:00100000:0.0:1789297360.847255:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957216384:12345-0@lo:400:kworker.0 00000020:00010000:2.0:1789297360.847643:0:7634:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982b39cbe000: total 0 00010000:00010000:2.0:1789297360.847693:0:7634:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982b39cbe000, canceled 0 locks, left on hash table 13. 00010000:00010000:2.0:1789297360.847755:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297360.847759:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297360.847769:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c3a8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc95 expref: 21 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297360.848197:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957216384:12345-0@lo:400:kworker.0 Request processed in 942us (1075us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297360.848206:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 168 00000100:00100000:1.0:1789297360.848669:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957216000:0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.848693:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00080000:1.0:1789297360.848720:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297360.848735:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957216512:0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.848787:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297360.849673:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957216384:0@lo:400:kworker.0 00000100:00100000:0.0:1789297360.849724:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216256 00000100:00100000:0.0:1789297360.849730:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216256 00000100:00100000:0.0:1789297360.849786:0:11700:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216512 00000100:00100000:0.0:1789297360.849789:0:11700:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216512 00000100:00080000:1.0:1789297360.849950:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789297360.849953:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297360.849985:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1789297360.849994:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957216256:12345-0@lo:400:kworker.0 00010000:00010000:2.0:1789297360.850149:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:2.0:1789297360.850154:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297360.850164:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256200/0x8ad177e823a0bdab lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daf8 expref: 21 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.850186:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982b2ac85b00) 00010000:00010000:2.0:1789297360.850189:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297360.850193:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257a00/0x8ad177e823a0b6c7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d91c expref: 20 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.850212:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297360.850214:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1789297360.850219:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0bd0a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dac7 expref: 19 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.850231:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982b03073300) 00010000:00010000:2.0:1789297360.850233:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297360.850237:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0b6ab lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d915 expref: 18 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.850259:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297360.850262:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1789297360.850266:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148fe00/0x8ad177e823a0bd34 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dad5 expref: 17 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.850281:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297360.850283:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00000100:00100000:1.0:1789297360.850964:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120af800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957216256:12345-0@lo:400:kworker.0 Request processed in 968us (4234us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297360.850973:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00010000:00010000:2.0:1789297360.851652:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256c00/0x8ad177e823a0c3d2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dca3 expref: 15 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.851681:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297360.851684:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297360.851689:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148f000/0x8ad177e823a0ba08 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da03 expref: 14 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.851719:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297360.851722:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789297360.851727:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0bdc7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57daff expref: 13 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.851743:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff982b2ac85c00) 00010000:00010000:2.0:1789297360.851745:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297360.851749:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e200/0x8ad177e823a0c0a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dbd1 expref: 12 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.851767:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff982b15d3a700) 00010000:00010000:2.0:1789297360.851770:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789297360.851774:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256000/0x8ad177e823a0bc2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57da8f expref: 11 pid: 5842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.851789:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff982b15d3ac00) 00010000:00010000:2.0:1789297360.851792:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1789297360.851796:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b059bb400/0x8ad177e823a0b71b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d931 expref: 10 pid: 7920 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297360.851895:0:11700:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789297360.851911:0:11700:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957216512:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297360.852659:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957216256:0@lo:400:kworker.0 00000100:00100000:3.0:1789297360.852912:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120aca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:235dd3df-f928-4719-bb69-fc817cc2744f+10:2352:x1876213933120128:12345-192.168.202.43@tcp:39:umount.0 Request processed in 7753us (8064us total) trans 4294967526 rc 0/0 00000100:00100000:3.0:1789297360.852922:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 240 00010000:00010000:2.0:1789297360.853064:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff982b08585900) 00010000:00010000:2.0:1789297360.853080:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1789297360.853087:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257e00/0x8ad177e823a0c2c8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dc5d expref: 8 pid: 5843 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297360.853104:0:7634:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982b39cbe000, canceled 13 locks, left on hash table 0. 00010000:00010000:2.0:1789297360.853143:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297360.853145:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297360.853148:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297360.859303:0:11700:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957216512:12345-0@lo:400:kworker.0 Request processed in 7375us (10492us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297360.859319:0:11700:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1789297360.859850:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38248000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957216512:0@lo:400:kworker.0 00000100:00100000:0.0:1789297361.344252:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957216640:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297361.344348:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297361.347283:0:6691:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216640 00000100:00100000:3.0:1789297361.347301:0:6691:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216640 00000100:00100000:3.0:1789297361.347385:0:6691:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1789297361.347411:0:6691:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957216640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297361.347454:0:6691:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297361.347551:0:6691:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b059cbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957216640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 141us (3202us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297361.347559:0:6691:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1789297361.349439:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957216640:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789297361.405533:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297361.853223:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1789297361.853253:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957216768:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297361.853333:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297361.853470:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216768 00000100:00100000:1.0:1789297361.853480:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216768 00000100:00100000:1.0:1789297361.853546:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789297361.853556:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957216768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297361.853589:0:6690:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297361.853644:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957216768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 89us (311us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297361.853651:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1789297361.853802:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957216768:0@lo:13:osp-pre-0-0.0 00000040:00080000:0.0:1789297362.108935:0:11697:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1789297362.108946:0:11697:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1789297362.109430:0:11697:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:0.0:1789297362.109438:0:11697:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1789297362.428878:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297362.963550:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297362.963617:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297362.963662:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297362.968904:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933120512 00000100:00100000:2.0:1789297362.968934:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933120512 00000100:00100000:2.0:1789297362.969168:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933120384 00000100:00100000:2.0:1789297362.969175:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933120384 00000100:00100000:2.0:1789297362.969211:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933120256 00000100:00100000:2.0:1789297362.969216:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933120256 00000100:00100000:2.0:1789297362.969245:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789297362.969257:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+12:2353:x1876213933120512:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297362.969279:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297362.969307:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b3800/0x8ad177e823a0b67a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d900 expref: 12 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297362.969332:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297362.969546:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+11:2353:x1876213933120512:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 288us (6005us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297362.969555:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789297362.969619:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:2.0:1789297362.969627:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02e80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+10:2355:x1876213933120384:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297362.969636:0:5828:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297362.969647:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062c00/0x8ad177e823a0b4ba lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d87b expref: 10 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297362.969658:0:5828:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297362.969678:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02e80450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f59e9b32-8d04-4473-8f89-1f536fa8f452+9:2355:x1876213933120384:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 53us (6061us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297362.969684:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:3.0:1789297362.970387:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:3.0:1789297362.970419:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f59e9b32-8d04-4473-8f89-1f536fa8f452+8:2355:x1876213933120256:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297362.970443:0:5827:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297362.970469:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059bac00/0x8ad177e823a0b4b3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d851 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297362.970488:0:5827:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297362.970546:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f59e9b32-8d04-4473-8f89-1f536fa8f452+7:2355:x1876213933120256:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 143us (6883us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297362.987736:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:1.0:1789297362.996581:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297362.996738:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933120768 00000100:00100000:0.0:1789297362.996749:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933120768 00000100:00100000:0.0:1789297362.996819:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 241 00000100:00100000:0.0:1789297362.996828:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+6:2352:x1876213933120768:12345-192.168.202.43@tcp:39:umount.0 00000020:00000080:0.0:1789297362.996872:0:5844:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b4c8 00000020:00010000:0.0:1789297362.996880:0:5844:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982b27c34800: total 0 00000100:00080000:0.0:1789297362.996885:0:5844:0:(import.c:65:import_set_state_nolock()) ffff982b27c37000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1789297362.996919:0:5844:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00100000:0.0:1789297362.997128:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:e029f0c5-35c9-4fe9-a40d-3a0871f25c48+5:2352:x1876213933120768:12345-192.168.202.43@tcp:39:umount.0 Request processed in 300us (556us total) trans 4294967527 rc 0/0 00000100:00100000:0.0:1789297362.997136:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 241 00000100:00080000:1.0:1789297362.999274:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000020:00010000:3.0:1789297362.999967:0:7634:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982b27c34800: total 0 00010000:00010000:3.0:1789297362.999976:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297363.000045:0:7634:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982b27c34800, canceled 0 locks, left on hash table 1. 00010000:00010000:3.0:1789297363.000081:0:7634:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85800) 00010000:00010000:3.0:1789297363.000086:0:7634:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297363.000099:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0148e400/0x8ad177e823a0c3f5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcb1 expref: 4 pid: 5844 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297363.000124:0:7634:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982b27c34800, canceled 1 locks, left on hash table 0. 00010000:00010000:3.0:1789297363.000136:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297363.000138:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297363.000139:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297363.020668:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297363.020856:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121024 00000100:00100000:3.0:1789297363.020874:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121024 00000100:00100000:3.0:1789297363.020954:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 302 00000100:00100000:3.0:1789297363.020966:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+7:2352:x1876213933121024:12345-192.168.202.43@tcp:251:umount.0 00000020:00000080:3.0:1789297363.021037:0:5836:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b3be 00000020:00010000:3.0:1789297363.021048:0:5836:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982a01708000: total 0 00000100:00080000:3.0:1789297363.021054:0:5836:0:(import.c:65:import_set_state_nolock()) ffff982a0170f000 : changing import state from FULL to CLOSED 00000100:00100000:3.0:1789297363.021159:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f59e9b32-8d04-4473-8f89-1f536fa8f452+3:2352:x1876213933121024:12345-192.168.202.43@tcp:251:umount.0 Request processed in 195us (504us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297363.021167:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 302 00000020:00010000:2.0:1789297363.021544:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982a01708000: total 0 00010000:00010000:2.0:1789297363.021622:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982a01708000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1789297363.021670:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42176c00/0x8ad177e823a0b474 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57d843 expref: 2 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297363.021688:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982a01708000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1789297363.021767:0:5830:0:(genops.c:885:class_export_put()) final put ffff982a01708000/f59e9b32-8d04-4473-8f89-1f536fa8f452 00010000:00010000:2.0:1789297363.021786:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297363.021789:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297363.021792:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789297363.021803:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a01708000/f59e9b32-8d04-4473-8f89-1f536fa8f452 for MGS 00000020:00000080:3.0:1789297363.021863:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a0170f000 for MGS 00010000:00010000:0.0:1789297363.452828:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297364.477842:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789297364.521572:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:1.0:1789297364.521603:0:6712:0:(genops.c:885:class_export_put()) final put ffff982b03390000/235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:1.0:1789297364.521642:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982b03390000/235dd3df-f928-4719-bb69-fc817cc2744f for lustre-OST0000 00000020:00000080:1.0:1789297364.521718:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b03397800 for lustre-OST0000 00000020:01000004:0.0:1789297364.826427:0:13025:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789297364.844617:0:13025:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1789297364.844674:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.844689:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.844696:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.844720:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.844738:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789297364.844742:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789297364.844772:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789297364.844777:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789297364.844799:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789297364.844827:0:13025:0:(import.c:65:import_set_state_nolock()) ffff982b1209b800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789297364.844861:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957216896:0@lo:39:umount.0 00000100:00100000:3.0:1789297364.844930:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297364.845473:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957216896 00000100:00100000:1.0:1789297364.846083:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957216896 00000100:00100000:1.0:1789297364.846145:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1789297364.846155:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876213957216896:12345-0@lo:39:umount.0 00000020:00000080:1.0:1789297364.846195:0:5843:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b1cd 00000100:00080000:1.0:1789297364.846203:0:5843:0:(import.c:65:import_set_state_nolock()) ffff982b399cc000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1789297364.847141:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+1:3301:x1876213957216896:12345-0@lo:39:umount.0 Request processed in 984us (2206us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297364.847152:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1789297364.847163:0:5843:0:(genops.c:885:class_export_put()) final put ffff982b399ca000/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1789297364.847201:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297364.847209:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.847219:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b42176400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297364.847224:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1789297364.847784:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b1209b800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:3.0:1789297364.847799:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957216896:0@lo:39:umount.0 00000100:00080000:3.0:1789297364.847831:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789297364.847834:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789297364.847839:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1789297364.848657:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297364.848667:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297364.848674:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1789297364.848677:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1789297364.848694:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1789297364.848744:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.848752:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297364.848777:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.848784:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b42176400/0x8ad177e823a0b443 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b44a expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.848801:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297364.848803:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297364.848805:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297364.848822:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957217024:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297364.848883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297364.848943:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217024 00000100:00100000:1.0:1789297364.848950:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217024 00000100:00100000:1.0:1789297364.849001:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789297364.849010:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+19:3305:x1876213957217024:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297364.849022:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297364.849037:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152a200/0x8ad177e823a0b44a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b443 expref: 19 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.849051:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297364.849082:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:3305:x1876213957217024:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (200us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297364.849089:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789297364.849122:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957217024:0@lo:103:ldlm_bl.0 00000020:00000080:0.0:1789297364.849634:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b399ca000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789297364.849688:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b399cc000 for lustre-MDT0000 00010000:00010000:0.0:1789297364.852673:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297364.853979:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.853996:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.854003:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.854009:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.854246:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297364.854254:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.854262:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.854268:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.854289:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.857665:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789297364.857680:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.857694:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297364.857698:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.857977:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297364.857984:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297364.857989:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789297364.857992:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:0.0:1789297364.858031:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.858038:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:2.0:1789297364.858102:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b385a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957217152:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297364.858186:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297364.858414:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.858422:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0b451 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b458 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.858437:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297364.858441:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.858445:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063a00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297364.858448:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.858455:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297364.858461:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297364.858572:0:7633:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217152 00000100:00100000:1.0:1789297364.858591:0:7633:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217152 00000100:00100000:1.0:1789297364.858650:0:7633:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1789297364.858660:0:7633:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:3302:x1876213957217152:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297364.858674:0:7633:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297364.858689:0:7633:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063000/0x8ad177e823a0b458 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b451 expref: 18 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.858723:0:7633:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297364.858850:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789297364.858864:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858872:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858879:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858887:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858903:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297364.858909:0:13025:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858916:0:13025:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858922:0:13025:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858927:0:13025:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.858948:0:13025:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:3.0:1789297364.858952:0:13025:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:3.0:1789297364.858957:0:13025:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:3.0:1789297364.858990:0:13025:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-MDT0000 00000020:01000000:3.0:1789297364.858994:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:3.0:1789297364.858998:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789297364.859004:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/9 00000020:00080000:3.0:1789297364.859009:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff982b406ea800 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789297364.859015:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff982a01dce800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789297364.859022:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff982b27c34800 e029f0c5-35c9-4fe9-a40d-3a0871f25c48 192.168.202.43@tcp 2 (0 2 0) 1 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789297364.859028:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000: UNLINKED ffff982b39cbe000 235dd3df-f928-4719-bb69-fc817cc2744f 192.168.202.43@tcp 6 (0 6 0) 1 0 0 0: 0000000000000000 4294967521 stale:0 00000020:00080000:3.0:1789297364.859033:0:13025:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff982b183699b8) has exports, disconnecting them 00000020:00080000:3.0:1789297364.859037:0:13025:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff982b406ea800), last request at 1789297360 00000020:00000080:3.0:1789297364.859043:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b340 00000100:00080000:3.0:1789297364.859059:0:13025:0:(import.c:65:import_set_state_nolock()) ffff982b406ed000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789297364.859102:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982b406ea800): rc 0 00000020:00000080:3.0:1789297364.859105:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b406ea800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00080000:3.0:1789297364.859115:0:13025:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff982a01dce800), last request at 1789297360 00000020:00000080:3.0:1789297364.859118:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b275 00000100:00080000:3.0:1789297364.859122:0:13025:0:(import.c:65:import_set_state_nolock()) ffff982a01dc8000 : changing import state from FULL to CLOSED 00000020:00080000:3.0:1789297364.859128:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982a01dce800): rc 0 00000020:00000080:3.0:1789297364.859130:0:13025:0:(genops.c:885:class_export_put()) final put ffff982a01dce800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:3.0:1789297364.859138:0:13025:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffb286c0d53ae0 00000100:00080000:3.0:1789297364.859157:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:3.0:1789297364.859160:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:3.0:1789297364.859172:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 10000000:01000000:0.0:1789297364.859337:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:0.0:1789297364.859341:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:0.0:1789297364.859343:0:7634:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:0.0:1789297364.859368:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.859374:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00080000:3.0:1789297364.859560:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:3.0:1789297364.859574:0:13025:0:(import.c:65:import_set_state_nolock()) ffff982b121d3800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:3.0:1789297364.859600:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:3.0:1789297364.859603:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:3.0:1789297364.859612:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:3.0:1789297364.859683:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957217408:0@lo:9:umount.0 00000100:00100000:3.0:1789297364.859755:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789297364.859798:0:13025:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:3.0:1789297364.859808:0:13025:0:(import.c:65:import_set_state_nolock()) ffff982b1209c000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000100:00100000:3.0:1789297364.859824:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957217536:0@lo:9:umount.0 00000100:00100000:3.0:1789297364.859849:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:3.0:1789297364.859897:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff982b183699b8) has no exports 00000100:00100000:1.0:1789297364.860071:0:7633:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824aa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:3302:x1876213957217152:12345-0@lo:103:ldlm_bl.0 Request processed in 1410us (1891us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297364.860080:0:7633:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00010000:00010000:1.0:1789297364.860112:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789297364.860118:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860125:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297364.860128:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860137:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297364.860143:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297364.860148:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1789297364.860151:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1789297364.860153:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1789297364.860180:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860199:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297364.860225:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860242:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b382b3400/0x8ad177e823a0b66c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b673 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860253:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297364.860257:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860262:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a600 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297364.860265:0:5829:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860272:0:5829:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297364.860278:0:5829:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297364.860283:0:5829:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1789297364.860286:0:5829:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1789297364.860288:0:5829:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1789297364.860468:0:5829:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860484:0:5829:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1789297364.860492:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860505:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152a600/0x8ad177e823a0b12c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b133 expref: -99 pid: 5822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.860524:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297364.860525:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297364.860527:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297364.860549:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217408 00000100:00100000:1.0:1789297364.860557:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217408 00000100:00100000:1.0:1789297364.860610:0:6689:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217536 00000100:00100000:1.0:1789297364.860614:0:6689:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217536 00000100:00100000:1.0:1789297364.860636:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789297364.860644:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876213957217408:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789297364.860671:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b2d0 00000100:00080000:1.0:1789297364.860678:0:6689:0:(import.c:65:import_set_state_nolock()) ffff982a0170e800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789297364.860747:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:1.0:1789297364.861082:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3301:x1876213957217408:12345-0@lo:9:umount.0 Request processed in 437us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297364.861090:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1789297364.861104:0:6689:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789297364.861111:0:6689:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b40941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3301:x1876213957217536:12345-0@lo:9:umount.0 00000020:00000080:1.0:1789297364.861126:0:6689:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b3a9 00000100:00080000:1.0:1789297364.861132:0:6689:0:(import.c:65:import_set_state_nolock()) ffff982b406ef000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1789297364.861146:0:6689:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:1.0:1789297364.861569:0:6689:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b40941880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+2:3301:x1876213957217536:12345-0@lo:9:umount.0 Request processed in 456us (1716us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297364.861585:0:6689:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1789297364.861619:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957217792:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297364.861667:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297364.861726:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789297364.861734:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957217664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297364.861756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789297364.861784:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789297364.861788:0:5838:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789297364.861802:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297364.861812:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217792 00000100:00100000:1.0:1789297364.861816:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217792 00000100:00100000:1.0:1789297364.861846:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217664 00000100:00100000:1.0:1789297364.861849:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217664 00000100:00100000:1.0:1789297364.861867:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297364.861873:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+18:3305:x1876213957217792:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297364.861884:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297364.861899:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00030000/0x8ad177e823a0b133 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b12c expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.861916:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297364.861945:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+17:3305:x1876213957217792:12345-0@lo:103:ldlm_bl.0 Request processed in 71us (277us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297364.861952:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:1.0:1789297364.861965:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789297364.861971:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+16:3305:x1876213957217664:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297364.861978:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297364.861986:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b3e00/0x8ad177e823a0b673 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b66c expref: 16 pid: 5836 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297364.861994:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297364.862022:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:3305:x1876213957217664:12345-0@lo:103:ldlm_bl.0 Request processed in 52us (265us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297364.862027:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1789297364.862076:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621fb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957217664:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297364.862084:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957217792:0@lo:103:ldlm_bl.0 00000100:00080000:1.0:1789297364.862118:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b1209c000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789297364.862131:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789297364.862133:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789297364.862136:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957217536:0@lo:9:umount.0 00000100:00080000:1.0:1789297364.862148:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b121d3800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:1.0:1789297364.862156:0:3301:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:1.0:1789297364.862157:0:3301:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1789297364.862159:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957217408:0@lo:9:umount.0 00010000:00010000:0.0:1789297364.862505:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.862515:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063a00/0x8ad177e823a0b378 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b37f expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297364.862529:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297364.862531:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297364.862533:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297364.862544:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957217280:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297364.862588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00000080:0.0:1789297364.862633:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982b406ea800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:0.0:1789297364.862673:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982a01dce800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:0.0:1789297364.862695:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b406ed000 for lustre-MDT0000 00000020:00000080:0.0:1789297364.862700:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a01dc8000 for lustre-MDT0000 00010000:00010000:0.0:1789297364.862819:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297364.862951:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217280 00000100:00100000:3.0:1789297364.862957:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217280 00000100:00100000:3.0:1789297364.863003:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789297364.863010:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0259e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+15:3303:x1876213957217280:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1789297364.863021:0:5826:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297364.863030:0:5826:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031600/0x8ad177e823a0b37f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b378 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297364.863044:0:5826:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297364.863078:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0259e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3303:x1876213957217280:12345-0@lo:103:ldlm_bl.0 Request processed in 68us (499us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297364.863084:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789297364.863110:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957217280:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297364.864060:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b385a1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957217152:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1789297364.873752:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff982b183699b8) has no exports 00000020:00000080:3.0:1789297364.945182:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b187 00000020:00000080:3.0:1789297364.945217:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b41cdb800/lustre-QMT0000_UUID 00000020:01000000:3.0:1789297364.945641:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:2.0:1789297364.945898:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789297364.945909:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789297364.945913:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff982b27c4cd28) has no exports 00000020:00000080:2.0:1789297364.946221:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b180 00000020:00000080:2.0:1789297364.946228:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b12fbf000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789297364.946313:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b41cdb800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1789297364.947060:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b12fbf000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:2.0:1789297364.947135:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789297364.947145:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:2.0:1789297364.947149:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b27c47000/lustre-QMT0000_UUID 00000020:00000080:2.0:1789297364.947152:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c47000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:2.0:1789297364.947160:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000001:00100000:1.0:1789297365.475843:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000001:00080000:1.0:1789297365.475861:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967527 is committed 00000020:00000080:1.0:1789297365.475868:0:5864:0:(genops.c:885:class_export_put()) final put ffff982b27c34800/e029f0c5-35c9-4fe9-a40d-3a0871f25c48 00000001:00080000:1.0:1789297365.475890:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000001:00100000:1.0:1789297365.476467:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000001:00080000:1.0:1789297365.476473:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1789297365.476477:0:5864:0:(genops.c:885:class_export_put()) final put ffff982b39cbe000/235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:1.0:1789297365.476494:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c34800/e029f0c5-35c9-4fe9-a40d-3a0871f25c48 for lustre-MDT0000 00000020:00000080:1.0:1789297365.476553:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b39cbe000/235dd3df-f928-4719-bb69-fc817cc2744f for lustre-MDT0000 00000020:00000080:1.0:1789297365.476596:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b27c37000 for lustre-MDT0000 00000020:00000080:1.0:1789297365.476601:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b39cb9000 for lustre-MDT0000 00010000:00010000:0.0:1789297365.501963:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1789297365.529031:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1789297365.529043:0:7644:0:(genops.c:885:class_export_put()) final put ffff982b406ec000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789297365.529191:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982b406ec000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:0.0:1789297365.529252:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b406ef000 for lustre-OST0001 00000001:00100000:2.0:1789297365.530286:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:2.0:1789297365.530293:0:7644:0:(genops.c:885:class_export_put()) final put ffff982b39c17800/235dd3df-f928-4719-bb69-fc817cc2744f 00000020:00000080:1.0:1789297365.532034:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b39c17800/235dd3df-f928-4719-bb69-fc817cc2744f for lustre-OST0001 00000020:00000080:1.0:1789297365.532097:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b39c10000 for lustre-OST0001 00000100:00100000:2.0:1789297365.949111:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0259df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957217920:0@lo:400:kworker.0 00000100:00100000:2.0:1789297365.949204:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297365.949433:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957217920 00000100:00100000:1.0:1789297365.949442:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957217920 00000100:00100000:1.0:1789297365.949498:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:1.0:1789297365.949507:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3302:x1876213957217920:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297365.949671:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957218048:0@lo:400:kworker.0 00000100:00100000:3.0:1789297365.949748:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297365.949791:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957218048 00000100:00100000:3.0:1789297365.949795:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957218048 00000100:00100000:3.0:1789297365.949822:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 243 00000100:00100000:3.0:1789297365.949828:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1876213957218048:12345-0@lo:400:kworker.0 00000020:00080000:3.0:1789297365.949834:0:7920:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:3.0:1789297365.949867:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3303:x1876213957218048:12345-0@lo:400:kworker.0 Request processed in 39us (119us total) trans 0 rc -107/-107 00000100:00100000:3.0:1789297365.949874:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 243 00000100:00080000:3.0:1789297365.949923:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0000 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:3.0:1789297365.949927:0:3303:0:(import.c:65:import_set_state_nolock()) ffff982a01dcd000 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:3.0:1789297365.949931:0:3303:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0000: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00100000:1.0:1789297365.971739:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b120e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f5de263b-4dfd-46a5-a3a7-afaeb125f055+14:3302:x1876213957217920:12345-0@lo:400:kworker.0 Request processed in 22223us (22524us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297365.971756:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:2.0:1789297365.976108:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0259df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3302:1876213957217920:0@lo:400:kworker.0 00000100:00100000:0.0:1789297365.978232:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1789297365.978251:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957218176:0@lo:400:kworker.0 00000100:00100000:0.0:1789297365.978508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297365.978562:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957218176 00000100:00100000:0.0:1789297365.978582:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957218176 00000100:00100000:0.0:1789297365.978626:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 244 00000100:00100000:0.0:1789297365.978634:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876213957218176:12345-0@lo:400:kworker.0 00000020:00080000:0.0:1789297365.978642:0:5843:0:(tgt_handler.c:807:tgt_request_handle()) operation 400 on unconnected OST from 12345-0@lo 00000100:00100000:0.0:1789297365.978679:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3305:x1876213957218176:12345-0@lo:400:kworker.0 Request processed in 45us (171us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789297365.978685:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 244 00000100:00080000:0.0:1789297365.978744:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import lustre-MDT0000-lwp-OST0001 of lustre-MDT0000_UUID@0@lo abruptly disconnected: reconnecting 00000100:00080000:0.0:1789297365.978749:0:3305:0:(import.c:65:import_set_state_nolock()) ffff982b06765800 lustre-MDT0000_UUID: changing import state from FULL to DISCONN 00000100:02000400:0.0:1789297365.978752:0:3305:0:(import.c:182:ptlrpc_set_import_discon()) lustre-MDT0000-lwp-OST0001: Connection to lustre-MDT0000 (at 0@lo) was lost; in progress operations using this service will wait for recovery to complete 00000100:00080000:0.0:1789297365.978757:0:3305:0:(import.c:65:import_set_state_nolock()) ffff982b06765800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789297365.978761:0:3305:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 188 00000100:00080000:0.0:1789297365.978767:0:3305:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff982b06765800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789297365.978794:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b276cdc00 x1876213957218304/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789297365.978811:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957218176:0@lo:400:kworker.0 00000100:00100000:1.0:1789297365.979084:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957218304:0@lo:38:ptlrpcd_00_03.0 00000100:00100000:1.0:1789297365.979119:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297365.985468:0:7920:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957218304 00000100:00100000:0.0:1789297365.985484:0:7920:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957218304 00000100:00100000:0.0:1789297365.985544:0:7920:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 245 00000100:00100000:0.0:1789297365.985554:0:7920:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3301:x1876213957218304:12345-0@lo:38:ptlrpcd_00_03.0 00010000:02000000:0.0:1789297365.985584:0:7920:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00080000:3.0:1789297365.989785:0:3303:0:(import.c:65:import_set_state_nolock()) ffff982a01dcd000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1789297365.989799:0:3303:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 169 00000100:00080000:3.0:1789297365.989808:0:3303:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff982a01dcd000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789297365.989852:0:3303:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b067b3100 x1876213957218432/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789297365.989889:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957218048:0@lo:400:kworker.0 00000100:00100000:2.0:1789297365.991631:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876213957218432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:2.0:1789297365.991734:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297366.007600:0:5843:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957218432 00000100:00100000:3.0:1789297366.007616:0:5843:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957218432 00000100:00100000:3.0:1789297366.007669:0:5843:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 246 00000100:00100000:3.0:1789297366.007677:0:5843:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1876213957218432:12345-0@lo:38:ptlrpcd_00_01.0 00010000:02000000:3.0:1789297366.007698:0:5843:0:(ldlm_lib.c:1203:target_handle_connect()) lustre-MDT0000: Not available for connect from 0@lo (stopping) 00000100:00100000:3.0:1789297366.007818:0:5843:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:3301:x1876213957218432:12345-0@lo:38:ptlrpcd_00_01.0 Request processed in 139us (16083us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789297366.007826:0:5843:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 246 00000100:00080000:2.0:1789297366.010651:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982a01dcd000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789297366.010663:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1789297366.010668:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876213957218432:0@lo:38:ptlrpcd_00_01.0 00000100:00100000:0.0:1789297366.021550:0:7920:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:3301:x1876213957218304:12345-0@lo:38:ptlrpcd_00_03.0 Request processed in 35989us (42422us total) trans 0 rc -19/-19 00000100:00100000:0.0:1789297366.021590:0:7920:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 245 00000100:00080000:3.0:1789297366.021766:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b06765800 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789297366.021772:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789297366.021776:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957218304:0@lo:38:ptlrpcd_00_03.0 00010000:00010000:0.0:1789297366.525786:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1789297366.972968:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982b059bca80 - data ffff982b31b8de58/ffff982b387d1400 00000020:01000000:2.0:1789297366.973127:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982b087170c0 - data ffff982b3186e360/ffff982b39ae5800 00000001:00000004:2.0:1789297366.980442:0:13025:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967527 00000100:00080000:0.0:1789297367.095814:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789297367.095824:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:0.0:1789297367.095837:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789297367.095840:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:3.0:1789297367.096663:0:7160:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:3.0:1789297367.096668:0:7160:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:3.0:1789297367.096678:0:7160:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:0.0:1789297367.097844:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789297367.097859:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:0.0:1789297367.097877:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789297367.097880:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:2.0:1789297367.101111:0:7925:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:2.0:1789297367.101118:0:7925:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:2.0:1789297367.101133:0:7925:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1789297367.195606:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b14f 00000020:00000080:2.0:1789297367.195620:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b27c40000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789297367.196686:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c40000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789297367.197520:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b164 00000020:00000080:0.0:1789297367.197528:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b27c46800/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789297367.197580:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:0.0:1789297367.197585:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297367.197594:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789297367.197802:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff982b1836cd28) has no exports 00000004:01000000:0.0:1789297367.198133:0:13025:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:0.0:1789297367.198144:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b3a2 00000020:00000080:0.0:1789297367.198149:0:13025:0:(genops.c:885:class_export_put()) final put ffff982a0170c800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789297367.200467:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c46800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789297367.201869:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1789297367.202341:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789297367.202358:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1789297367.202372:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff982b40cacd28) has no exports 00000020:00000080:2.0:1789297367.202383:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b39b 00000020:00000080:2.0:1789297367.202392:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b03312000/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789297367.204216:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0170c800/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789297367.215616:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b03312000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789297367.217140:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789297367.217148:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:0.0:1789297367.217152:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:0.0:1789297367.217159:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789297367.217162:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789297367.217202:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297367.217215:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789297367.217223:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b2bb 00000020:00000080:0.0:1789297367.217232:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b40ec2000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:0.0:1789297367.217238:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:0.0:1789297367.217244:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297367.217260:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789297367.217264:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff982b40b40000) has no exports 00000020:00000080:0.0:1789297367.217272:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b2b4 00000020:00000080:0.0:1789297367.217276:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b121d5800/lustre-MDT0000-osd_UUID 00000020:00000080:3.0:1789297367.217890:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b1209c000 for lustre-OST0001-osc-MDT0000 00000020:00000080:3.0:1789297367.217898:0:37:0:(genops.c:885:class_export_put()) final put ffff982a0170d000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789297367.217900:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a0170d000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:3.0:1789297367.217909:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789297367.217987:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b40ec2000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789297367.217992:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b121d5800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:0.0:1789297367.218755:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:0.0:1789297367.218759:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:0.0:1789297367.218762:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:0.0:1789297367.218768:0:13025:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1789297367.218770:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789297367.218804:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297367.218813:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789297367.218841:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297367.218845:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789297367.218848:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b18050800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:0.0:1789297367.218851:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff982b18050800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:0.0:1789297367.218855:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1789297367.219065:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b121d3800 for lustre-OST0000-osc-MDT0000 00000020:00000080:3.0:1789297367.219072:0:37:0:(genops.c:885:class_export_put()) final put ffff982b41f7a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789297367.219074:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b41f7a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:3.0:1789297367.219078:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1789297367.219341:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b16b 00000020:00000080:0.0:1789297367.219347:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b27c40800/lustre-MDD0000_UUID 00000020:01000000:0.0:1789297367.219360:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:0.0:1789297367.219364:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297367.219373:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789297367.219376:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff982b27c4b370) has no exports 00000020:00000080:0.0:1789297367.219399:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297367.219402:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:0.0:1789297367.219405:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b172 00000020:00000080:0.0:1789297367.219410:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b27c44000/lustre-MDT0000-osd_UUID 00000020:01000004:0.0:1789297367.219417:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982b07359800 from lustre-MDT0000, refs=3 00000020:01000004:0.0:1789297367.219420:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b07359800 3 00000020:01000004:0.0:1789297367.219423:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982b07359800 from lustre-MDT0000 00000020:00000080:0.0:1789297367.219438:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297367.219440:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:0.0:1789297367.219442:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b27c41000/lustre-MDT0000_UUID 00000020:00000080:0.0:1789297367.219453:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c41000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:0.0:1789297367.219461:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:0.0:1789297367.219487:0:13025:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:0.0:1789297367.219490:0:13025:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:0.0:1789297367.219493:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:0.0:1789297367.219495:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297367.219497:0:13025:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789297367.219502:0:13025:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff982b11f7c800 f5de263b-4dfd-46a5-a3a7-afaeb125f055 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789297367.219507:0:13025:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff982b02e44d28) has exports, disconnecting them 00000020:00080000:0.0:1789297367.219512:0:13025:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff982b11f7c800), last request at 1789297137 00000020:00000080:0.0:1789297367.219532:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b110 00000020:00010000:0.0:1789297367.219536:0:13025:0:(genops.c:1921:obd_stale_export_put()) Put export ffff982b11f7c800: total 2 00000100:00080000:0.0:1789297367.219540:0:13025:0:(import.c:65:import_set_state_nolock()) ffff982b11f7f000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1789297367.219552:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982b11f7c800): rc 0 00000020:00080000:0.0:1789297367.219565:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff982b02e44d28) has no exports 00000020:00010000:0.0:1789297367.219577:0:5830:0:(genops.c:1907:obd_stale_export_get()) Get export ffff982b11f7c800: total 2 00010000:00010000:0.0:1789297367.219596:0:5830:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff982b11f7c800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1789297367.219933:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b42176600/0x8ad177e823a0b420 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b419 expref: 9 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.219950:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063800/0x8ad177e823a0b42e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b427 expref: 8 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.219961:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152a000/0x8ad177e823a0b657 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b650 expref: 7 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.219970:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062800/0x8ad177e823a0b43c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b435 expref: 6 pid: 5837 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.219980:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b059baa00/0x8ad177e823a0b466 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b45f expref: 5 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.220002:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152b400/0x8ad177e823a0b665 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b65e expref: 4 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.220019:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20063e00/0x8ad177e823a0b228 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b221 expref: 3 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.220031:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b20062a00/0x8ad177e823a0b412 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x8ad177e823a0b40b expref: 2 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297367.220041:0:5830:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff982b11f7c800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1789297367.220055:0:5830:0:(genops.c:885:class_export_put()) final put ffff982b11f7c800/f5de263b-4dfd-46a5-a3a7-afaeb125f055 00010000:00010000:0.0:1789297367.220060:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297367.220062:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297367.220064:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297367.223153:0:5835:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff982b050dc200:5835] 0 exiting: rc = 1 00000020:00000080:3.0:1789297367.223776:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c40800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:3.0:1789297367.223784:0:37:0:(genops.c:885:class_export_put()) final put ffff982b27c41800/lustre-MDD0000_UUID 00000020:00000080:3.0:1789297367.223786:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c41800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:3.0:1789297367.223791:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:3.0:1789297367.223961:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b27c44000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:3.0:1789297367.223967:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b11f7c800/f5de263b-4dfd-46a5-a3a7-afaeb125f055 for MGS 00000020:00000080:3.0:1789297367.224013:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b11f7f000 for MGS 00000100:00100000:2.0:1789297367.226657:0:5836:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff982b050dcc00:5836] 1 exiting: rc = 0 00000100:00100000:1.0:1789297367.226918:0:5837:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff982b1835da00:5837] 2 exiting: rc = 0 00000100:00100000:0.0:1789297367.227009:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227018:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227024:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227029:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227034:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227039:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227045:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227052:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227058:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227063:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227069:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227075:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227080:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227086:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227091:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227097:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227120:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227128:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227135:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227141:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227146:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227152:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227158:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227163:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227168:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227174:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227179:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227185:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227190:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227196:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227201:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227206:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227210:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227216:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227220:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227225:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227229:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227234:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227238:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227243:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227248:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227254:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227259:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227264:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227268:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227273:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227289:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227294:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227299:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227304:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227308:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227320:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227325:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227330:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227335:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227345:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227353:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227359:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227365:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227371:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227376:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227381:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227386:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.227392:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:0.0:1789297367.227985:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1789297367.227990:0:13025:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:0.0:1789297367.228460:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982b039038a0 - data ffff982b2bb5f6c0/ffff982b39c9a400 00000020:01000000:0.0:1789297367.228601:0:13025:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982b086b0d20 - data ffff982b2bb0d510/ffff982b35db9000 00000020:00000080:3.0:1789297367.246594:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b0f4 00000020:00000080:3.0:1789297367.246785:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b0735b800/lustre-MDT0000-osd_UUID 00000020:01000004:3.0:1789297367.246798:0:13025:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982b07359800 from MGS, refs=2 00000020:01000004:3.0:1789297367.246801:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b07359800 2 00000020:01000004:3.0:1789297367.246804:0:13025:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982b07359800 from MGS 00000020:00000080:3.0:1789297367.246831:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789297367.246838:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:3.0:1789297367.246841:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b0735f000/MGS 00000020:00000080:3.0:1789297367.246844:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff982b0735f000/MGS for MGS 00000020:01000000:3.0:1789297367.246909:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:3.0:1789297367.247033:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:3.0:1789297367.247038:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789297367.247044:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789297367.247052:0:13025:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff982b41f7d000 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789297367.247059:0:13025:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff982b27c499b8) has exports, disconnecting them 00000020:00080000:3.0:1789297367.247065:0:13025:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff982b41f7d000), last request at 1789297138 00000020:00000080:3.0:1789297367.247069:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b1bf 00000020:00080000:3.0:1789297367.247082:0:13025:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982b41f7d000): rc 0 00000020:00000080:3.0:1789297367.247087:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b41f7d000/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1789297367.247107:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982b0735b800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789297367.247127:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982b41f7d000/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:2.0:1789297367.252879:0:13025:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:2.0:1789297367.252887:0:13025:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789297367.252891:0:13025:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789297367.252898:0:13025:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789297367.253063:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b1209b800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:2.0:1789297367.253118:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1789297367.253128:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:2.0:1789297367.253133:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b1209f000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:2.0:1789297367.253137:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff982b1209f000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:2.0:1789297367.253151:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:2.0:1789297367.253242:0:13025:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b07359800 1 00000020:00000080:2.0:1789297367.253247:0:13025:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b0e6 00000020:00000080:2.0:1789297367.253253:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b0735f800/lustre-MDT0000-osd_UUID 00000020:01000000:2.0:1789297367.253267:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:2.0:1789297367.253271:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1789297367.253275:0:13025:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1789297367.253278:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff982b02e43370) has no exports 00000020:00000080:0.0:1789297367.253344:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982b0735f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1789297367.317275:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297367.317290:0:13025:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1789297367.317295:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b0735c800/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1789297367.317300:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff982b0735c800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1789297367.317309:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1789297367.317542:0:13025:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff982b07359000 00000020:01000000:0.0:1789297367.317577:0:13025:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1789297367.317582:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297367.317587:0:13025:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1789297367.317592:0:13025:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff982b1836b370) has no exports 00000100:00100000:0.0:1789297367.317723:0:7920:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff982b0519c000:7920] 3 exiting: rc = 0 00000100:00100000:2.0:1789297367.317735:0:5844:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff982b050bda00:5844] 2 exiting: rc = 0 00000100:00100000:2.0:1789297367.317875:0:5842:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff982b050bca00:5842] 0 exiting: rc = 1 00000100:00100000:0.0:1789297367.318806:0:5843:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff982b050bcc00:5843] 1 exiting: rc = 0 00000100:00100000:2.0:1789297367.318983:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.318995:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319005:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319016:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319028:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319037:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319049:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319059:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319071:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319081:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319099:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319110:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319121:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319131:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319142:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319307:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319317:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319322:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319327:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319333:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319338:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319344:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319350:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319355:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319361:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319367:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319374:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319381:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319390:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319396:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319403:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319410:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319417:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319422:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319428:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319435:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319442:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319450:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319457:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319465:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319472:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319479:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319486:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319493:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319499:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319516:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319525:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319536:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319543:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319548:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319597:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319607:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319615:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319622:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319630:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319636:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319643:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319651:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319659:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319666:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319673:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319680:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319687:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.319760:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.325571:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff982b11f0b000:5845] 0 exiting: rc = 1 00000100:00100000:0.0:1789297367.326054:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff982b050bce00:5846] 1 exiting: rc = 0 00000100:00100000:3.0:1789297367.326104:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326112:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326121:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326129:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326134:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326138:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326143:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326146:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326150:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326155:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326171:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326176:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326180:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326184:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326187:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326191:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326194:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326198:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326201:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326204:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326207:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326210:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326214:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326216:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326219:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326222:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326225:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326228:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326231:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326235:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326237:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326240:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326243:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326246:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326249:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326251:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326254:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326257:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326261:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326264:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326267:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326270:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326273:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326276:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326279:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326285:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326288:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326291:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326294:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326297:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326300:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326303:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326306:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326308:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326311:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326314:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326317:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326322:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326379:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326383:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326386:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326389:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326392:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.326395:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.326807:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff982b2a640000:5848] 1 exiting: rc = 0 00000100:00100000:2.0:1789297367.326813:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff982b11f0b600:5847] 0 exiting: rc = 1 00000100:00100000:3.0:1789297367.328005:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328015:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328021:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328027:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328033:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328040:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328046:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328052:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328058:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328077:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328083:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328089:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328094:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328101:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328106:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328113:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328129:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328135:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328141:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328147:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328167:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328189:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328197:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328203:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328210:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328216:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328222:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328229:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328235:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328242:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328248:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328254:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328260:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328280:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328287:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328293:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328299:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328304:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328316:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328322:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328328:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328334:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328340:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328346:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328351:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328374:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328382:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328388:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328394:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328400:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328406:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328420:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328425:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328433:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328439:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328445:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328450:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328471:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328478:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328483:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328491:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328497:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328502:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.328516:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.335267:0:5850:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff982b2a641e00:5850] 1 exiting: rc = 0 00000100:00100000:1.0:1789297367.335929:0:5849:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff982b2a618a00:5849] 0 exiting: rc = 1 00000100:00100000:3.0:1789297367.336107:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336115:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336121:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336127:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336133:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336138:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336144:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336149:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336155:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336161:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336166:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336172:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336177:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336182:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336187:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336193:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336199:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336205:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336210:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336216:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336221:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336226:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336244:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336249:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336254:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336259:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336264:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336269:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336274:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336279:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336285:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336290:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336295:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336301:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336320:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336335:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336340:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336345:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336351:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336356:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336361:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336366:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336371:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336376:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336382:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336388:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336393:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336399:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336405:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336411:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336416:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336421:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336425:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336431:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336437:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336442:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336447:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336460:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336465:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336470:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336475:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336480:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336486:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336491:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.336842:0:5851:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff982b2a641200:5851] 0 exiting: rc = 1 00000100:00100000:1.0:1789297367.337010:0:5852:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff982b2a640e00:5852] 1 exiting: rc = 0 00000100:00100000:3.0:1789297367.337172:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337179:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337186:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337191:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337197:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337202:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337207:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337211:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337217:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337223:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337228:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337233:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337241:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337248:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337255:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337263:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337270:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337281:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.337290:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339748:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339772:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339777:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339783:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339788:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339794:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339798:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339803:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339822:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339827:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339832:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339836:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339841:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339845:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339850:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339855:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339860:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339864:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339869:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339874:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339879:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339884:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339889:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339894:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339899:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339904:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339908:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339912:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339917:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339922:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339928:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339934:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339939:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339944:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339961:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339967:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339972:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339977:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339982:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339988:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339992:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.339997:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.340002:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.340014:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297367.340019:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.342265:0:5853:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff982b2a637600:5853] 0 exiting: rc = 1 00000100:00100000:1.0:1789297367.342603:0:5854:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff982b2a637000:5854] 1 exiting: rc = 0 00000100:00100000:1.0:1789297367.342681:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342688:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342694:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342700:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342750:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342757:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342763:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342768:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342773:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342779:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342784:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342789:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342794:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342800:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342805:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342810:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342826:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342832:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342837:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342842:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342847:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342851:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342856:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342862:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342867:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342872:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342878:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342882:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342887:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342891:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342896:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342901:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342907:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342912:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342917:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342922:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342927:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342932:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342937:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342943:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342948:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342953:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342958:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342964:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342968:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342973:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342977:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342982:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342987:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342992:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.342997:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343008:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343013:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343017:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343022:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343026:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343031:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343365:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343476:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343481:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343486:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343490:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343495:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1789297367.343500:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297367.344932:0:5855:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff982b2a63c200:5855] 0 exiting: rc = 1 00000100:00100000:3.0:1789297367.345377:0:5856:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff982b11f0de00:5856] 1 exiting: rc = 0 00000100:00100000:1.0:1789297367.345616:0:5857:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff982b11f0d400:5857] 2 exiting: rc = 0 00000100:00100000:0.0:1789297367.345826:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346605:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346614:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346620:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346625:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346632:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346637:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346642:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346647:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346664:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346671:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346677:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346682:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346687:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346693:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346699:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346735:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346745:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346773:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346785:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346792:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346797:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346802:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346808:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346813:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346818:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346824:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346830:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346836:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346841:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346941:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346956:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346962:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346968:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346974:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346979:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346985:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346991:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.346996:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347001:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347007:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347012:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347029:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347035:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347041:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347046:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347052:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347058:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347064:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347069:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347075:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347080:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347086:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347091:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347097:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347103:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347108:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347114:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347120:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347125:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347131:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347136:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347142:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1789297367.347148:0:13025:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:0.0:1789297367.357952:0:13025:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297367.357966:0:13025:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:0.0:1789297367.357985:0:13025:0:(genops.c:885:class_export_put()) final put ffff982b0678a000/MDS_uuid 00000020:00000080:0.0:1789297367.357990:0:13025:0:(genops.c:844:class_export_destroy()) destroying export ffff982b0678a000/MDS_uuid for MDS 00000020:01000000:0.0:1789297367.358001:0:13025:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:0.0:1789297367.358134:0:13025:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:1.0:1789297367.556644:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297368.583685:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297369.604237:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789297369.609431:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1789297369.609441:0:6712:0:(genops.c:885:class_export_put()) final put ffff982a01708800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1789297369.609787:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff982a01708800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1789297369.609837:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a0170e800 for lustre-OST0000 00000020:01000004:3.0:1789297370.329219:0:13180:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789297370.350288:0:13180:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0000 00010000:00010000:3.0:1789297370.350333:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.350349:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.350356:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.350362:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.350387:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789297370.350392:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789297370.350413:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789297370.350417:0:13180:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789297370.350422:0:13180:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789297370.350427:0:13180:0:(import.c:65:import_set_state_nolock()) ffff982a01dcd000 lustre-MDT0000_UUID: changing import state from DISCONN to CLOSED 00000100:00080000:3.0:1789297370.350432:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789297370.350433:0:13180:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789297370.350436:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1789297370.351283:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351312:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351319:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351325:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351344:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1789297370.351358:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1789297370.351364:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351371:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20062200 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297370.351376:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351384:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297370.351392:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297370.351398:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789297370.351401:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1789297370.351403:0:7634:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1789297370.351441:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351456:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297370.351480:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351486:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20062200/0x8ad177e823a0b427 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b42e expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351499:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297370.351502:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351507:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20063200 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:3.0:1789297370.351511:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351517:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1789297370.351523:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297370.351538:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1789297370.351540:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 00010000:00010000:3.0:1789297370.351552:0:7634:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351558:0:7634:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1789297370.351580:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351596:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20063200/0x8ad177e823a0b435 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b43c expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351606:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297370.351608:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297370.351610:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297370.351619:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297370.351635:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957218688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297370.351737:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1789297370.351797:0:13180:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351805:0:13180:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351811:0:13180:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351817:0:13180:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297370.351835:0:13180:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789297370.351840:0:13180:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 10000000:01000000:3.0:1789297370.351843:0:13180:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:3.0:1789297370.351862:0:13180:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0000 00000020:01000000:3.0:1789297370.351866:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:3.0:1789297370.351870:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789297370.351876:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789297370.351882:0:13180:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff982a017019b8) has no exports 00000020:00080000:3.0:1789297370.351913:0:13180:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff982a017019b8) has no exports 00000020:01000000:3.0:1789297370.353480:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982b18249de0 - data ffff982b2b9511b0/ffff982b059dd800 00010000:00010000:0.0:1789297370.355768:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297370.355783:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297370.355796:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2c00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297370.355801:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297370.355810:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297370.355817:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297370.355823:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789297370.355826:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:0.0:1789297370.355831:0:5830:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:0.0:1789297370.355883:0:5830:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297370.355891:0:5830:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1789297370.355913:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297370.355920:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0b65e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000020 nid: local remote: 0x8ad177e823a0b665 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297370.355952:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297370.355954:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297370.355956:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297370.355976:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957218560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297370.356046:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297370.356103:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957218816:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297370.356139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297370.356171:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957218688 00000100:00100000:0.0:1789297370.356180:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957218688 00000100:00100000:0.0:1789297370.356213:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957218560 00000100:00100000:0.0:1789297370.356216:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957218560 00000100:00100000:0.0:1789297370.356223:0:5826:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957218816 00000100:00100000:0.0:1789297370.356225:0:5826:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957218816 00000100:00100000:0.0:1789297370.356236:0:5826:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789297370.356244:0:5826:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02e82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1876213957218688:12345-0@lo:103:ldlm_bl.0 00010000:00020000:0.0:1789297370.356250:0:5826:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789297370 with bad export cookie 10002908086280433936 00010000:00010000:1.0:1789297370.357656:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297370.357684:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789297370.357694:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1876213957218560:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789297370.357701:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789297370 with bad export cookie 10002908086280433936 00000100:00100000:1.0:1789297370.357811:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3305:x1876213957218560:12345-0@lo:103:ldlm_bl.0 Request processed in 116us (1765us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789297370.357818:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1789297370.357840:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1789297370.357844:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3303:x1876213957218816:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1789297370.357849:0:5827:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1789297370 with bad export cookie 10002908086280433936 00000100:00100000:1.0:1789297370.357879:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:0+-99:3303:x1876213957218816:12345-0@lo:103:ldlm_bl.0 Request processed in 33us (1739us total) trans 0 rc -107/-107 00000100:00100000:1.0:1789297370.357885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1789297370.358378:0:3305:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:1.0:1789297370.358383:0:3305:0:(import.c:65:import_set_state_nolock()) ffff982b0735a800 MGS: changing import state from FULL to DISCONN 00000100:02020000:1.0:1789297370.358387:0:3305:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.202.143@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00000100:00080000:2.0:1789297370.368805:0:3303:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.202.143@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000020:01000000:3.0:1789297370.369049:0:13180:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982b11fb97e0 - data ffff982b2bb3fca8/ffff982a01f81800 00000100:00100000:0.0:1789297370.373863:0:5826:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02e82450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:0+-99:3303:x1876213957218688:12345-0@lo:103:ldlm_bl.0 Request processed in 17612us (22120us total) trans 0 rc -107/-107 00000100:00100000:0.0:1789297370.373878:0:5826:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00080000:1.0:1789297370.399116:0:3305:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.202.143@tcp not replayable, auto-deactivating 00000100:00080000:1.0:1789297370.399121:0:3305:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:1.0:1789297370.399130:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982b067b3800 x1876213957218688/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789297386 ref 1 fl Rpc:RQ/200/ffffffff rc 0/-1 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297370.399145:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982b067b1f80 x1876213957218560/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789297386 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297370.399261:0:3305:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982b276cca80 x1876213957218816/t0(0) o103->MGC192.168.202.143@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1789297386 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:1.0:1789297370.399270:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:1.0:1789297370.399272:0:3305:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:1.0:1789297370.399274:0:3305:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1789297370.399335:0:3303:0:(import.c:214:ptlrpc_set_import_discon()) mgc: import ffff982b0735a800 already not connected (conn 1, was 1): DISCONN 00000100:00080000:1.0:1789297370.400512:0:3305:0:(import.c:65:import_set_state_nolock()) ffff982b0735a800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789297370.401374:0:3305:0:(import.c:510:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 149 00000100:00080000:1.0:1789297370.401384:0:3305:0:(import.c:624:import_select_connection()) MGC192.168.202.143@tcp: import ffff982b0735a800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789297370.401471:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957218688:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297370.401504:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3303:1876213957218816:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1789297370.402013:0:3305:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b067b3800 x1876213957218944/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789297370.402041:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3305:1876213957218560:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297370.402104:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3301:1876213957218944:0@lo:250:ptlrpcd_00_03.0 00000400:00000100:2.0:1789297370.402170:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1876213957218944 offset 0 length 520: 4 00100000:10000000:1.0:1789297370.419397:0:13180:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:3.0:1789297370.466055:0:13180:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b244 00000020:00000080:3.0:1789297370.466067:0:13180:0:(genops.c:885:class_export_put()) final put ffff982a01709000/lustre-OST0000-osd_UUID 00000020:01000004:3.0:1789297370.466086:0:13180:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982b121d2000 from lustre-OST0000, refs=2 00000020:01000004:3.0:1789297370.466089:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b121d2000 2 00000020:01000004:3.0:1789297370.466093:0:13180:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982b121d2000 from lustre-OST0000 00000020:00000080:3.0:1789297370.466119:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789297370.466141:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:3.0:1789297370.466145:0:13180:0:(genops.c:885:class_export_put()) final put ffff982b39f5b800/lustre-OST0000_UUID 00000020:00000080:3.0:1789297370.466148:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff982b39f5b800/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:3.0:1789297370.466157:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:3.0:1789297370.466213:0:13180:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:3.0:1789297370.466218:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:3.0:1789297370.466223:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789297370.466228:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:3.0:1789297370.466236:0:13180:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff982a01dc8800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:3.0:1789297370.466241:0:13180:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff982b02e419b8) has exports, disconnecting them 00000020:00080000:3.0:1789297370.466246:0:13180:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff982a01dc8800), last request at 1789297157 00000020:00000080:3.0:1789297370.466252:0:13180:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b26e 00000020:00080000:3.0:1789297370.466262:0:13180:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982a01dc8800): rc 0 00000020:00000080:3.0:1789297370.466283:0:13180:0:(genops.c:885:class_export_put()) final put ffff982a01dc8800/lustre-MDT0000-lwp-OST0000 00000020:00000080:0.0:1789297370.466780:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a01709000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:0.0:1789297370.466799:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a01dc8800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:0.0:1789297370.496305:0:13180:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:0.0:1789297370.496315:0:13180:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1789297370.496320:0:13180:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1789297370.496328:0:13180:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1789297370.496576:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297370.496598:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:0.0:1789297370.496606:0:13180:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b121d2000 1 00000020:00000080:0.0:1789297370.496621:0:13180:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b1fe 00000020:00000080:0.0:1789297370.496630:0:13180:0:(genops.c:885:class_export_put()) final put ffff982b1209e800/lustre-OST0000-osd_UUID 00000020:01000000:0.0:1789297370.496636:0:13180:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:0.0:1789297370.496642:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297370.496647:0:13180:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:0.0:1789297370.496652:0:13180:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff982b40b419b8) has no exports 00000020:00000080:1.0:1789297370.496808:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982a01dcd000 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1789297370.496816:0:37:0:(genops.c:885:class_export_put()) final put ffff982a016e7000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1789297370.496819:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982a016e7000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1789297370.496828:0:37:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1789297370.496886:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff982b1209e800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1789297370.516107:0:13180:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1789297370.516136:0:13180:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1789297370.516143:0:13180:0:(genops.c:885:class_export_put()) final put ffff982b121d4800/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1789297370.516148:0:13180:0:(genops.c:844:class_export_destroy()) destroying export ffff982b121d4800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1789297370.516160:0:13180:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1789297370.516325:0:13180:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff982b121d2800 00000020:02000400:1.0:1789297370.516367:0:13180:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1789297370.636090:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789297371.075658:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1789297371.075670:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:1.0:1789297371.075674:0:37:0:(import.c:65:import_set_state_nolock()) ffff982b06765800 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789297371.075682:0:37:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 377 00000100:00080000:1.0:1789297371.075687:0:37:0:(import.c:589:import_select_connection()) lustre-MDT0000-lwp-OST0001: tried all connections, increasing latency to 5s 00000100:00080000:1.0:1789297371.075695:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff982b06765800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789297371.075765:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38224380 x1876213957219072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789297371.075853:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957219072:0@lo:38:kworker.0 00000400:00000100:3.0:1789297371.075910:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1876213957219072 offset 0 length 520: 4 00010000:00010000:0.0:1789297371.646501:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297372.668925:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1789297373.384303:0:13330:0:(tgt_mount.c:2195:server_umount_begin()) umount -f 00000020:01000004:3.0:1789297373.399878:0:13330:0:(tgt_mount.c:2065:server_put_super()) server put_super lustre-OST0001 00010000:00010000:3.0:1789297373.399966:0:13330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.399984:0:13330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.399991:0:13330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.399998:0:13330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.400027:0:13330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1789297373.400033:0:13330:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1789297373.400058:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789297373.400071:0:13330:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982b38224380 x1876213957219072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789297386 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297373.400089:0:13330:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:3.0:1789297373.400106:0:13330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1789297373.400113:0:13330:0:(import.c:65:import_set_state_nolock()) ffff982b06765800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00080000:3.0:1789297373.400118:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1789297373.400122:0:13330:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982b38224380 x1876213957219072/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 1789297386 ref 1 fl Rpc:ENQr/200/ffffffff rc -5/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297373.400150:0:13330:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:3.0:1789297373.400154:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 17s for inflight to error out 00010000:00010000:0.0:1789297373.400253:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297373.400261:0:7634:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.400269:0:7634:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbe00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297373.400273:0:7634:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.400282:0:7634:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297373.400291:0:7634:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297373.400297:0:7634:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789297373.400299:0:7634:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:0.0:1789297373.400302:0:7634:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:0.0:1789297373.400316:0:7634:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982b0735a800 00010000:00010000:0.0:1789297373.400321:0:7634:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.400327:0:7634:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059bbe00/0x8ad177e823a0b40b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b412 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.400352:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297373.400354:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297373.400356:0:7634:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297373.400698:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957219072:0@lo:38:kworker.0 00010000:00010000:3.0:1789297373.402292:0:13330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.402311:0:13330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.402318:0:13330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.402325:0:13330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.402520:0:13330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297373.402529:0:13330:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.402537:0:13330:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.402543:0:13330:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297373.402549:0:13330:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.403899:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789297373.403909:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.403919:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b20062400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297373.403923:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.403933:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297373.403940:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297373.403946:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789297373.403949:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 00010000:00010000:0.0:1789297373.403961:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982b0735a800 00010000:00010000:0.0:1789297373.403965:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.403972:0:5830:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b20062400/0x8ad177e823a0b419 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b420 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.403986:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297373.403989:0:5830:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.404014:0:5830:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb600 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:0.0:1789297373.404018:0:5830:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.404025:0:5830:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297373.404031:0:5830:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297373.404036:0:5830:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:0.0:1789297373.404039:0:5830:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 00010000:00010000:0.0:1789297373.404044:0:5830:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982b0735a800 00010000:00010000:0.0:1789297373.404047:0:5830:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.404054:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297373.404056:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297373.404058:0:5830:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297373.405961:0:13330:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1789297373.405973:0:13330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059bb600/0x8ad177e823a0b650 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b657 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297373.406009:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log params 10000000:01000000:3.0:1789297373.406015:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 10000000:01000000:3.0:1789297373.406017:0:13330:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:3.0:1789297373.406048:0:13330:0:(tgt_mount.c:2115:server_put_super()) stopping lustre-OST0001 00000020:01000000:3.0:1789297373.406052:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:3.0:1789297373.406542:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789297373.406551:0:13330:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789297373.406556:0:13330:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff982a01700000) has no exports 00000020:00080000:3.0:1789297373.406589:0:13330:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff982a01700000) has no exports 00010000:00010000:1.0:1789297373.408009:0:5829:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:3.0:1789297373.410593:0:13330:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982b18249900 - data ffff982b31bf3948/ffff982b059dfc00 00000020:01000000:3.0:1789297373.410964:0:13330:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff982a01f13180 - data ffff982b3fc83e58/ffff982b39c26800 00100000:10000000:1.0:1789297373.426442:0:13330:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1789297373.453178:0:13330:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b30f 00000020:00000080:0.0:1789297373.453189:0:13330:0:(genops.c:885:class_export_put()) final put ffff982b406eb800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1789297373.453209:0:13330:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982a01db8800 from lustre-OST0001, refs=2 00000020:01000004:0.0:1789297373.453212:0:13330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a01db8800 2 00000020:01000004:0.0:1789297373.453216:0:13330:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff982a01db8800 from lustre-OST0001 00000020:00000080:0.0:1789297373.453242:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297373.453252:0:13330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1789297373.453255:0:13330:0:(genops.c:885:class_export_put()) final put ffff982b406ed800/lustre-OST0001_UUID 00000020:00000080:0.0:1789297373.453258:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff982b406ed800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1789297373.453264:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1789297373.453458:0:13330:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import f5de263b-4dfd-46a5-a3a7-afaeb125f055->MGS 00010000:00010000:0.0:1789297373.453473:0:13330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b228 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297373.453484:0:13330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b228 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297373.453491:0:13330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1789297373.453494:0:13330:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1789297373.453505:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1789297373.453520:0:13330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982b0735a800 00010000:00010000:0.0:1789297373.453524:0:13330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152b000/0x8ad177e823a0b221 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b228 expref: -99 pid: 6684 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297373.453544:0:13330:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x8ad177e823a0b466 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1789297373.453551:0:13330:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x8ad177e823a0b466 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297373.453556:0:13330:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1789297373.453558:0:13330:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1789297373.453560:0:13330:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1789297373.453570:0:13330:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff982b0735a800 00010000:00010000:0.0:1789297373.453573:0:13330:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0152a800/0x8ad177e823a0b45f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x8ad177e823a0b466 expref: -99 pid: 5839 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1789297373.453590:0:13330:0:(import.c:65:import_set_state_nolock()) ffff982b0735a800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1789297373.453594:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1789297373.453596:0:13330:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1789297373.453598:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1789297373.453602:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1789297373.453621:0:13330:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff982b067b3800 x1876213957218944/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1789297380 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_03.0' uid:0 gid:0 projid:4294967295 00000020:00000080:2.0:1789297373.453729:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982b406eb800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 10000000:01000000:0.0:1789297373.453816:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789297373.453820:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 9s for inflight to error out 00000100:00100000:3.0:1789297373.454253:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f5de263b-4dfd-46a5-a3a7-afaeb125f055:3301:1876213957218944:0@lo:250:ptlrpcd_00_03.0 10000000:01000000:0.0:1789297373.454319:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1789297373.454327:0:13330:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b102 00000020:00000080:0.0:1789297373.454332:0:13330:0:(genops.c:885:class_export_put()) final put ffff982b0735d800/f5de263b-4dfd-46a5-a3a7-afaeb125f055 00000020:01000000:0.0:1789297373.454433:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.202.143@tcp (flags='') 00000020:00000080:0.0:1789297373.454439:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297373.454446:0:13330:0:(obd_config.c:956:class_cleanup()) MGC192.168.202.143@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1789297373.454449:0:13330:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff982b18368000) has no exports 10000000:01000000:3.0:1789297373.454518:0:5839:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1789297373.454608:0:13330:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.202.143@tcp: client import never connected 00000100:00080000:0.0:1789297373.454612:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1789297373.454614:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1789297373.454616:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1789297373.454617:0:13330:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:2.0:1789297373.454650:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982b0735d800/f5de263b-4dfd-46a5-a3a7-afaeb125f055 for MGC192.168.202.143@tcp 00000020:00000080:0.0:1789297373.455411:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1789297373.455419:0:13330:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.202.143@tcp (uuid f5de263b-4dfd-46a5-a3a7-afaeb125f055) 00000020:01000000:0.0:1789297373.455424:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1789297373.455428:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1789297373.455432:0:13330:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1789297373.455438:0:13330:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff982b399ce800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1789297373.455443:0:13330:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff982b40b43370) has exports, disconnecting them 00000020:00080000:0.0:1789297373.455448:0:13330:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff982b399ce800), last request at 1789297176 00000020:00000080:0.0:1789297373.455453:0:13330:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b339 00000020:00080000:0.0:1789297373.455465:0:13330:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff982b399ce800): rc 0 00000020:00000080:0.0:1789297373.455469:0:13330:0:(genops.c:885:class_export_put()) final put ffff982b399ce800/lustre-MDT0000-lwp-OST0001 00000020:00000080:2.0:1789297373.455661:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b0735a800 for MGC192.168.202.143@tcp 00000020:00000080:2.0:1789297373.455671:0:38:0:(genops.c:885:class_export_put()) final put ffff982b06789000/f5de263b-4dfd-46a5-a3a7-afaeb125f055 00000020:00000080:2.0:1789297373.455674:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982b06789000/f5de263b-4dfd-46a5-a3a7-afaeb125f055 for MGC192.168.202.143@tcp 00000020:01000000:2.0:1789297373.455682:0:38:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.202.143@tcp (f5de263b-4dfd-46a5-a3a7-afaeb125f055) 00000020:00000080:2.0:1789297373.456446:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982b399ce800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00010000:01000000:2.0:1789297373.458799:0:13330:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:2.0:1789297373.458809:0:13330:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1789297373.458815:0:13330:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:2.0:1789297373.458825:0:13330:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1789297373.459078:0:38:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff982b06765800 for lustre-MDT0000-lwp-OST0001 00010000:00010000:2.0:1789297373.462771:0:7634:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00010000:00010000:2.0:1789297373.463092:0:5830:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:2.0:1789297373.463271:0:5829:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:2.0:1789297373.463478:0:5825:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff982b0515d800:5825] 1 exiting: rc = 0 00000100:00100000:2.0:1789297373.464007:0:5824:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff982b05aec200:5824] 0 exiting: rc = 1 00000100:00100000:3.0:1789297373.464109:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.464412:0:7633:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff982b40ff8600:7633] 3 exiting: rc = 0 00000100:00100000:2.0:1789297373.465067:0:5827:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff982b02e2dc00:5827] 1 exiting: rc = 0 00000100:00100000:1.0:1789297373.465314:0:5828:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff982b02e2de00:5828] 2 exiting: rc = 0 00000100:00100000:2.0:1789297373.473914:0:5826:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff982b02e2c200:5826] 0 exiting: rc = 1 00000100:00100000:3.0:1789297373.474126:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474135:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474141:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474146:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474151:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474158:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474164:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474169:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474176:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474182:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474189:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474194:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474207:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474215:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474237:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474242:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474248:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474255:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474260:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474265:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474271:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474276:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474282:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474288:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474300:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474306:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474312:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474318:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474323:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474328:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474333:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474338:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474343:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474348:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474354:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474358:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474364:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474368:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474373:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474378:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474384:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474389:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474393:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474398:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474403:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474416:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474421:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474430:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474436:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474453:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474458:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474463:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474472:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474478:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474483:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474488:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474494:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474508:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474513:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474519:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474524:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474529:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474534:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.474540:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1789297373.478006:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789297373.478020:0:13330:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:3.0:1789297373.478026:0:13330:0:(genops.c:885:class_export_put()) final put ffff982b41f7d800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:3.0:1789297373.478031:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff982b41f7d800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:3.0:1789297373.478037:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:3.0:1789297373.478090:0:13330:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982a01db8800 1 00000020:00000080:3.0:1789297373.478109:0:13330:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x8ad177e823a0b2de 00000020:00000080:3.0:1789297373.478116:0:13330:0:(genops.c:885:class_export_put()) final put ffff982a016e5800/lustre-OST0001-osd_UUID 00000020:01000000:3.0:1789297373.478135:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:3.0:1789297373.478140:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789297373.478144:0:13330:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1789297373.478148:0:13330:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff982b40cab370) has no exports 00000020:00000080:2.0:1789297373.478598:0:38:0:(genops.c:844:class_export_destroy()) destroying export ffff982a016e5800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:3.0:1789297373.497394:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789297373.497412:0:13330:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:3.0:1789297373.497418:0:13330:0:(genops.c:885:class_export_put()) final put ffff982a01dbe000/lustre-OST0001-osd_UUID 00000020:00000080:3.0:1789297373.497423:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff982a01dbe000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:3.0:1789297373.497433:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:3.0:1789297373.497623:0:13330:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff982a01dbc800 00000020:01000000:3.0:1789297373.497658:0:13330:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:3.0:1789297373.497662:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1789297373.497668:0:13330:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:3.0:1789297373.497673:0:13330:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff982b27c48000) has no exports 00000020:00000080:3.0:1789297373.497697:0:13330:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1789297373.497721:0:13330:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:3.0:1789297373.497725:0:13330:0:(genops.c:885:class_export_put()) final put ffff982b12098800/OSS_uuid 00000020:00000080:3.0:1789297373.497727:0:13330:0:(genops.c:844:class_export_destroy()) destroying export ffff982b12098800/OSS_uuid for OSS 00000020:01000000:3.0:1789297373.497735:0:13330:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00080000:1.0:1789297373.499193:0:5838:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:1.0:1789297373.499573:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff982b1fe45e00:6688] 1 exiting: rc = 0 00000100:00100000:1.0:1789297373.499638:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff982b1fe44000:6687] 0 exiting: rc = 1 00000100:00100000:1.0:1789297373.499696:0:11700:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff982b2768d600:11700] 3 exiting: rc = 0 00000100:00100000:2.0:1789297373.499802:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff982b10726c00:6689] 2 exiting: rc = 0 00000100:00100000:3.0:1789297373.502015:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502027:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502035:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502041:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502046:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502051:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502057:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502062:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502068:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502073:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502078:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502083:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502089:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502107:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502114:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502120:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502125:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502130:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502135:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502140:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502145:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502150:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502156:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502160:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502166:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502171:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502189:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502194:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502199:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502205:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502211:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502319:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502328:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502335:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502340:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502345:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502350:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502355:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502361:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502366:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502372:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502377:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502383:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502388:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502393:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502399:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502404:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502409:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502415:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502421:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502427:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502432:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502438:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502443:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502448:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502452:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502458:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502467:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502475:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502481:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502487:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502508:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502513:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.502519:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297373.503797:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff982b063b9c00:6691] 1 exiting: rc = 0 00000100:00100000:1.0:1789297373.504118:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff982b063b8800:6690] 0 exiting: rc = 1 00000100:00100000:3.0:1789297373.504486:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504493:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504508:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504513:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504519:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504525:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504530:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504536:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504541:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504546:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504551:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504556:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504562:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504567:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504573:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504577:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504583:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504588:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504594:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504599:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504604:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504610:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504615:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504620:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504625:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504630:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504635:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504641:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504646:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504651:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504656:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504661:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504676:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504681:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504686:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504691:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504696:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504737:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504744:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504750:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504755:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504760:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504766:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504772:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504777:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504782:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504786:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504791:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504796:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504802:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504806:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504811:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504817:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504822:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504827:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504833:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504838:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504843:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504848:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504853:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504858:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504863:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504868:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.504872:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297373.506751:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff982b11f0ce00:6692] 0 exiting: rc = 1 00000100:00100000:0.0:1789297373.507087:0:6694:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff982b1fc48e00:6694] 2 exiting: rc = 0 00000100:00100000:0.0:1789297373.507383:0:6693:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff982b1fc49600:6693] 1 exiting: rc = 0 00000100:00100000:3.0:1789297373.507625:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507636:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507642:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507672:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507679:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507684:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507690:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507695:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507700:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507731:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507736:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507742:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507748:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507754:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507769:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507777:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507782:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507788:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507794:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507801:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507806:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507812:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507818:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507824:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507830:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507836:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507844:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507851:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507857:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507863:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507869:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507875:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507881:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507888:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507904:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507911:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507916:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507922:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507950:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507956:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507961:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507967:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507972:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507977:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507984:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507990:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.507996:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508001:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508007:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508012:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508017:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508023:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508028:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508034:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508039:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508044:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508050:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508056:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508062:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508068:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508074:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508089:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508106:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.508113:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1789297373.515224:0:6695:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff982b1fc49400:6695] 0 exiting: rc = 1 00000100:00100000:1.0:1789297373.515482:0:6696:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff982b1fc49e00:6696] 1 exiting: rc = 0 00000100:00100000:3.0:1789297373.515654:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515663:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515670:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515675:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515681:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515686:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515692:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515698:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515731:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515748:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515753:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515759:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515765:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515770:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515776:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515781:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515786:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515792:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515800:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515804:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515810:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515814:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515820:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515825:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515830:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515836:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515841:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515846:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515851:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515856:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515861:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515867:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515872:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515877:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515882:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515887:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515903:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515909:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515914:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515919:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515924:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515928:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515933:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515938:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515951:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515956:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515962:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515966:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515971:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515976:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515981:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515986:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515991:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.515995:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516000:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516005:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516010:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516014:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516020:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516025:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516030:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516036:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516042:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516047:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.516802:0:6698:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff982b39f48600:6698] 1 exiting: rc = 0 00000100:00100000:2.0:1789297373.517051:0:6697:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff982b39f49800:6697] 0 exiting: rc = 1 00000100:00100000:3.0:1789297373.517254:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517261:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517267:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517272:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517278:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517284:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517289:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517295:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517301:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517318:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517325:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517330:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517337:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517343:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517359:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517365:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517371:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517377:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517383:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517390:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517396:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517416:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517423:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517430:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517435:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517442:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517446:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517451:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517457:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517463:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517469:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517474:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517480:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517513:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517520:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517527:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517533:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517539:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517545:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517550:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517556:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517562:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517568:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517573:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517579:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517598:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517606:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517612:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517618:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517631:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517636:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517642:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517650:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517656:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517662:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517670:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517676:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517696:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517736:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517743:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517749:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517755:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517762:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1789297373.517775:0:13330:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:3.0:1789297373.528659:0:13330:0:(tgt_mount.c:2184:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:2.0:1789297392.405831:0:13947:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing load_modules_local 00000020:01000004:1.0:1789297400.905565:0:14407:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789297400.905572:0:14407:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:1.0:1789297400.905748:0:14407:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982b055c7000 00000020:01000004:1.0:1789297400.905765:0:14407:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:1.0:1789297400.905774:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789297400.905788:0:14407:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff982b40ca99b8) 00000020:00000080:1.0:1789297400.905802:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1789297400.938593:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1789297400.943589:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:0.0:1789297400.944461:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 512: rc = 0 00100000:10000000:0.0:1789297400.944568:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 512: rc = 0 00100000:10000000:0.0:1789297400.945093:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 512: rc = 0 00100000:10000000:0.0:1789297400.945315:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1789297400.945393:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 512: rc = 0 00100000:10000000:0.0:1789297400.945495:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 512: rc = 0 00100000:10000000:0.0:1789297400.945597:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 512: rc = 0 00100000:10000000:0.0:1789297400.947367:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 514: rc = 0 00100000:10000000:0.0:1789297400.949682:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 94: rc = 0 00100000:10000000:0.0:1789297400.949842:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 94: rc = 0 00100000:10000000:1.0:1789297400.952630:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 95: rc = 0 00100000:10000000:1.0:1789297400.953177:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 95: rc = 0 00100000:10000000:1.0:1789297400.953452:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 95: rc = 0 00100000:10000000:1.0:1789297400.953735:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 95: rc = 0 00100000:10000000:1.0:1789297400.953987:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 95: rc = 0 00100000:10000000:1.0:1789297400.954233:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 95: rc = 0 00100000:10000000:1.0:1789297400.954490:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 95: rc = 0 00100000:10000000:1.0:1789297400.954778:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 95: rc = 0 00100000:10000000:1.0:1789297400.955014:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 95: rc = 0 00100000:10000000:1.0:1789297400.955274:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 95: rc = 0 00100000:10000000:1.0:1789297400.955524:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 95: rc = 0 00100000:10000000:1.0:1789297400.955814:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 95: rc = 0 00100000:10000000:1.0:1789297400.962735:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 120: rc = 0 00100000:10000000:1.0:1789297400.963583:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 120: rc = 0 00100000:10000000:1.0:1789297400.964513:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 120: rc = 0 00100000:10000000:1.0:1789297400.965115:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 120: rc = 0 00100000:10000000:1.0:1789297400.965381:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 120: rc = 0 00100000:10000000:1.0:1789297400.965805:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 120: rc = 0 00100000:10000000:1.0:1789297400.966188:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 120: rc = 0 00100000:10000000:1.0:1789297400.966454:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 120: rc = 0 00100000:10000000:1.0:1789297400.966829:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 120: rc = 0 00100000:10000000:1.0:1789297400.967334:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 120: rc = 0 00100000:10000000:1.0:1789297400.968205:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 120: rc = 0 00100000:10000000:1.0:1789297400.968476:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 120: rc = 0 00100000:10000000:1.0:1789297400.968839:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 120: rc = 0 00100000:10000000:1.0:1789297400.969250:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 120: rc = 0 00100000:10000000:1.0:1789297400.969519:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 120: rc = 0 00100000:10000000:1.0:1789297400.970040:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 120: rc = 0 00100000:10000000:1.0:1789297400.970312:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 120: rc = 0 00100000:10000000:1.0:1789297400.970567:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 120: rc = 0 00100000:10000000:1.0:1789297400.971109:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 120: rc = 0 00100000:10000000:1.0:1789297400.971377:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 120: rc = 0 00100000:10000000:1.0:1789297400.974561:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 120: rc = 0 00100000:10000000:1.0:1789297400.974876:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 120: rc = 0 00100000:10000000:1.0:1789297400.977545:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 120: rc = 0 00100000:10000000:1.0:1789297400.977899:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 120: rc = 0 00100000:10000000:1.0:1789297400.978154:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 120: rc = 0 00100000:10000000:1.0:1789297400.978426:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 120: rc = 0 00100000:10000000:1.0:1789297400.978693:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 120: rc = 0 00100000:10000000:1.0:1789297400.978972:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 120: rc = 0 00100000:10000000:1.0:1789297400.979211:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 120: rc = 0 00100000:10000000:2.0:1789297400.984307:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 120: rc = 0 00100000:10000000:2.0:1789297400.984603:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 120: rc = 0 00100000:10000000:2.0:1789297400.985405:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 120: rc = 0 00100000:10000000:2.0:1789297400.989485:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 109: rc = 0 00100000:10000000:2.0:1789297400.991504:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:2.0:1789297400.992771:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 262: rc = 0 00100000:10000000:2.0:1789297400.993010:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:2.0:1789297400.993087:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 262: rc = 0 00100000:10000000:2.0:1789297400.993286:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:2.0:1789297400.993354:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 262: rc = 0 00100000:10000000:2.0:1789297400.995849:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:2.0:1789297400.995957:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 499: rc = 0 00100000:10000000:2.0:1789297400.996178:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:2.0:1789297400.996265:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 499: rc = 0 00100000:10000000:2.0:1789297400.996444:0:14407:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:2.0:1789297400.996513:0:14407:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 499: rc = 0 00000020:00000080:2.0:1789297400.998113:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1789297400.998123:0:14407:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789297400.998135:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0c403 00000020:01000004:2.0:1789297400.998144:0:14407:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1789297400.998149:0:14407:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1789297400.998155:0:14407:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982b055c7000 from MGS 00000020:01000004:2.0:1789297400.998159:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1789297400.998170:0:14407:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff982b02e40000) 00000020:00000080:2.0:1789297400.998180:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1789297400.998233:0:14407:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b055c7000 from MGS, refs=2 00080000:01000000:2.0:1789297400.998247:0:14407:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789297400.998254:0:14407:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0c411 00000100:00100000:2.0:1789297400.998358:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1789297400.998495:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1789297400.998501:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1789297401.003743:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1789297401.003758:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:2.0:1789297401.004418:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789297401.004598:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:2.0:1789297401.004603:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1789297401.006063:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1789297401.006074:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1789297401.006450:0:14407:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1789297401.006456:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1789297401.007286:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297401.007290:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297401.007291:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297401.008260:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297401.008264:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297401.008266:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297401.010438:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1789297401.014227:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1789297401.031184:0:14407:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1789297401.031202:0:14407:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1789297401.031206:0:14407:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1789297401.037496:0:14416:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1789297401.037661:0:14407:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1789297401.037794:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789297401.038383:0:14407:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:3.0:1789297401.039335:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789297401.039515:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:3.0:1789297401.039521:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:3.0:1789297401.042441:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:3.0:1789297401.042462:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:2.0:1789297401.042855:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:2.0:1789297401.042861:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:2.0:1789297401.050097:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:2.0:1789297401.050121:0:14407:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.202.143@tcp' 00000020:01000004:2.0:1789297401.050123:0:14407:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:2.0:1789297401.050160:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.202.143@tcp (typ=mgc) 00000020:00000080:2.0:1789297401.050171:0:14407:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.202.143@tcp (ffff982b02e419b8) 00000020:00000080:2.0:1789297401.050186:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:2.0:1789297401.050268:0:14407:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982b30f15000@MGC192.168.202.143@tcp: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789297401.050421:0:14407:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.202.143@tcp-0 is initialized 00000040:01000000:2.0:1789297401.050428:0:14407:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 1 is initialized 00000100:00080000:3.0:1789297401.050995:0:14421:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:2.0:1789297401.058001:0:14422:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:0.0:1789297401.059905:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.202.143@tcp (uuid 930f46ad-32d3-437c-8414-ecdb73298d0c) 00000020:00000080:0.0:1789297401.059931:0:14407:0:(genops.c:1385:class_connect()) connect: client 930f46ad-32d3-437c-8414-ecdb73298d0c, cookie 0x8ad177e823a0c41f 00000100:00080000:0.0:1789297401.060067:0:14407:0:(import.c:510:import_select_connection()) MGC192.168.202.143@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1789297401.060075:0:14407:0:(import.c:624:import_select_connection()) MGC192.168.202.143@tcp: import ffff982b30f15000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789297401.060111:0:14407:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b276cc380 x1876213957219200/t0(0) o250->MGC192.168.202.143@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1789297401.060142:0:14407:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 930f46ad-32d3-437c-8414-ecdb73298d0c->MGS 00000020:01000004:0.0:1789297401.060175:0:14407:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:0.0:1789297401.060181:0:14407:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:0.0:1789297401.060195:0:14407:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff982b40b44d28) 00000020:00000080:0.0:1789297401.060208:0:14407:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:1.0:1789297401.064416:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:930f46ad-32d3-437c-8414-ecdb73298d0c:3301:1876213957219200:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1789297401.064504:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.064624:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957219200 00000100:00100000:2.0:1789297401.064633:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957219200 00000100:00100000:2.0:1789297401.064678:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297401.064686:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3301:x1876213957219200:12345-0@lo:250:mount.lustre.0 00010000:00080000:2.0:1789297401.064732:0:14417:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 930f46ad-32d3-437c-8414-ecdb73298d0c@0@lo t0 exp 0000000000000000 cur 412 last 0 00000020:00000080:2.0:1789297401.064758:0:14417:0:(genops.c:1385:class_connect()) connect: client 930f46ad-32d3-437c-8414-ecdb73298d0c, cookie 0x8ad177e823a0c42d 00000100:00080000:2.0:1789297401.064895:0:14417:0:(import.c:65:import_set_state_nolock()) ffff982b30f17000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297401.064951:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+5:3301:x1876213957219200:12345-0@lo:250:mount.lustre.0 Request processed in 264us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297401.064960:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789297401.065111:0:3301:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.202.143@tcp: committing for last_committed 0 gen 1 00000100:00080000:1.0:1789297401.065121:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.202.143@tcp: connect to target with instance 0 00000100:00080000:1.0:1789297401.065130:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.202.143@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:1.0:1789297401.065135:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:1.0:1789297401.065137:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b30f15000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:1.0:1789297401.065140:0:3301:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:1.0:1789297401.065155:0:3301:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:1.0:1789297401.065160:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cc380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:930f46ad-32d3-437c-8414-ecdb73298d0c:3301:1876213957219200:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1789297401.082837:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297401.083083:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:0.0:1789297401.083090:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:0.0:1789297401.093343:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:0.0:1789297401.093359:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1789297401.094188:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1789297401.094199:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1789297401.095391:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297401.095597:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1789297401.095658:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1789297401.096668:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1789297401.096678:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1789297401.136819:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789297401.137262:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1789297401.137269:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1789297401.138552:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1789297401.138564:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1789297401.139472:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297401.139647:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789297401.139653:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1789297401.140415:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789297401.140423:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1789297401.141212:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297401.141390:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1789297401.141397:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1789297401.142099:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789297401.142107:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:1.0:1789297401.147460:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1789297401.147657:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:1.0:1789297401.147664:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1789297401.148477:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1789297401.148485:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1789297401.164899:0:14407:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789297401.165244:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1789297401.165251:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1789297401.166726:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1789297401.166739:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1789297401.167401:0:14407:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1789297401.167409:0:14407:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1789297401.168455:0:14407:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1789297401.168477:0:14407:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1789297401.168483:0:14407:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1789297401.168615:0:14407:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:1.0:1789297401.168651:0:14407:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20005 00000020:01000004:1.0:1789297401.168656:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1789297401.168657:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789297401.168658:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297401.168660:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297401.168661:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297401.168662:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297401.168663:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789297401.168665:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789297401.168667:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297401.168669:0:14407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789297401.168671:0:14407:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:1.0:1789297401.168673:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789297401.168674:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1789297401.168675:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297401.168676:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297401.168677:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297401.168678:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297401.168679:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1789297401.168680:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1789297401.168681:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297401.168682:0:14407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1789297401.168837:0:14407:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1789297401.168863:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219328:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789297401.168938:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297401.169065:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b219b9540 going to sleep for 11 seconds 00000100:00100000:2.0:1789297401.169234:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957219328 00000100:00100000:2.0:1789297401.169252:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957219328 00000100:00100000:2.0:1789297401.169338:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297401.169348:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+5:14407:x1876213957219328:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1789297401.169396:0:14420:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1789297401.169400:0:14420:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1789297401.169403:0:14420:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:2.0:1789297401.169668:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:1.0:1789297401.170215:0:14420:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:1.0:1789297401.173333:0:14442:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:1.0:1789297401.173343:0:14442:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:1.0:1789297401.173346:0:14442:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:1.0:1789297401.173380:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:3.0:1789297401.173793:0:14420:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1789297401.173806:0:14420:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:1.0:1789297401.186810:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+5:14407:x1876213957219328:12345-0@lo:253:mount.lustre.0 Request processed in 17454us (17861us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.186829:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297401.187029:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219328:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789297401.187044:0:14407:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:0.0:1789297401.187047:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789297401.187049:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1789297401.187051:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297401.187052:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297401.187053:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297401.187055:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297401.187056:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1789297401.187058:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1789297401.187059:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297401.187060:0:14407:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789297401.187076:0:14407:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982b055c7000 from lustre-MDT0000 10000000:01000000:0.0:1789297401.187102:0:14407:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:0.0:1789297401.187105:0:14407:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:0.0:1789297401.187167:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff982b02e419b8 10000000:01000000:0.0:1789297401.187172:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789297401.187179:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff982b02e419b8 from 1 10000000:01000000:0.0:1789297401.187182:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1789297401.187217:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.187248:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.187259:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297401.187280:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219456:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789297401.187316:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297401.187386:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1c3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.187434:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957219456 00000100:00100000:1.0:1789297401.187442:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957219456 00000100:00100000:1.0:1789297401.187515:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789297401.187526:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+5:14407:x1876213957219456:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789297401.187538:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297401.187553:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b3400/0x8ad177e823a0c43b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c434 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.187575:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b3400/0x8ad177e823a0c43b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c434 expref: 6 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.187585:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b3400/0x8ad177e823a0c43b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c434 expref: 6 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.187594:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3400, rc 0) 00000100:00100000:1.0:1789297401.187644:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+6:14407:x1876213957219456:12345-0@lo:101:mount.lustre.0 Request processed in 121us (328us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.187650:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297401.187741:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ce300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219456:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789297401.187753:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.187762:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.187809:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219584:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297401.187849:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.188549:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789297401.188634:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957219584 00000100:00100000:0.0:1789297401.188640:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957219584 00000100:00100000:0.0:1789297401.188671:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789297401.188679:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+6:14407:x1876213957219584:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789297401.188954:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+6:14407:x1876213957219584:12345-0@lo:501:mount.lustre.0 Request processed in 275us (1115us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789297401.188970:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297401.189317:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219584:0@lo:501:mount.lustre.0 10000000:01000000:2.0:1789297401.189352:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1789297401.189366:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.189376:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297401.189386:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982b055c7000 10000000:01000000:2.0:1789297401.189390:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1789297401.189407:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff982b055c7000 10000000:01000000:2.0:1789297401.189410:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:2.0:1789297401.189413:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff982b055c7000 from 1 10000000:01000000:2.0:1789297401.189416:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:2.0:1789297401.189446:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256200/0x8ad177e823a0c442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.189453:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b38256200/0x8ad177e823a0c442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.189462:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b38256200/0x8ad177e823a0c442 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.189478:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219712:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789297401.189508:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.189521:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3900 going to sleep for 11 seconds 00000100:00100000:0.0:1789297401.189595:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957219712 00000100:00100000:0.0:1789297401.189600:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957219712 00000100:00100000:0.0:1789297401.189621:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789297401.189627:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+6:14407:x1876213957219712:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297401.189636:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297401.189648:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059baa00/0x8ad177e823a0c449 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c442 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.189665:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059baa00/0x8ad177e823a0c449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c442 expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.189686:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059baa00/0x8ad177e823a0c449 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c442 expref: 7 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.189693:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059baa00, rc 0) 00000100:00100000:0.0:1789297401.189831:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+7:14407:x1876213957219712:12345-0@lo:101:mount.lustre.0 Request processed in 203us (321us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297401.189837:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297401.190283:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219712:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789297401.190296:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b38256200/0x8ad177e823a0c442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c449 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.190304:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b38256200/0x8ad177e823a0c442 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c449 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297401.190318:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:2.0:1789297401.190366:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256200/0x8ad177e823a0c442 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c449 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.190374:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b38256200/0x8ad177e823a0c442 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c449 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297401.190392:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:2.0:1789297401.190396:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789297401.190401:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff982b055c7000 10000000:01000000:2.0:1789297401.190405:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:2.0:1789297401.190408:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:2.0:1789297401.190410:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1789297401.190429:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256600/0x8ad177e823a0c450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.190436:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b38256600/0x8ad177e823a0c450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.190444:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b38256600/0x8ad177e823a0c450 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.190456:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219840:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789297401.190482:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.190512:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3900 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.190562:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957219840 00000100:00100000:1.0:1789297401.190567:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957219840 00000100:00100000:1.0:1789297401.190606:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789297401.190614:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+7:14407:x1876213957219840:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789297401.190622:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297401.190631:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b3e00/0x8ad177e823a0c457 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c450 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.190645:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b3e00/0x8ad177e823a0c457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c450 expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.190654:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b3e00/0x8ad177e823a0c457 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c450 expref: 8 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.190661:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3e00, rc 0) 00000100:00100000:1.0:1789297401.190700:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+8:14407:x1876213957219840:12345-0@lo:101:mount.lustre.0 Request processed in 87us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.190767:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297401.190848:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219840:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789297401.190860:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b38256600/0x8ad177e823a0c450 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c457 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.190867:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b38256600/0x8ad177e823a0c450 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c457 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.190912:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297401.190936:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.191090:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789297401.191217:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957219968 00000100:00100000:3.0:1789297401.191223:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957219968 00000100:00100000:3.0:1789297401.191261:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789297401.191269:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+8:14407:x1876213957219968:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297401.191637:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14407:x1876213957219968:12345-0@lo:501:mount.lustre.0 Request processed in 366us (698us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297401.191643:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789297401.191911:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957219968:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297401.191956:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297401.192069:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.192099:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3900 going to sleep for 11 seconds 00000100:00100000:3.0:1789297401.192227:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957220096 00000100:00100000:3.0:1789297401.192233:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957220096 00000100:00100000:3.0:1789297401.192277:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297401.192284:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14407:x1876213957220096:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789297401.192593:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14407:x1876213957220096:12345-0@lo:503:mount.lustre.0 Request processed in 307us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297401.192599:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1789297401.192752:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220096:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297401.193501:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14443:1876213957220224:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297401.193555:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.193621:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.193662:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957220224 00000100:00100000:1.0:1789297401.193668:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957220224 00000100:00100000:1.0:1789297401.193774:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789297401.193783:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14443:x1876213957220224:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297401.194302:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14443:x1876213957220224:12345-0@lo:502:llog_process_th.0 Request processed in 519us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.194310:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1789297401.194394:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14443:1876213957220224:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789297401.194419:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297401.194429:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.194432:0:14443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789297401.194437:0:14443:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:2.0:1789297401.194440:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789297401.194454:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff982b02e43370) 00000020:00000080:2.0:1789297401.194474:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:2.0:1789297401.194479:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:2.0:1789297401.194541:0:14443:0:(osd_handler.c:1573:osd_obd_connect()) connect #2 00000020:00000080:2.0:1789297401.194549:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0c465 00000020:00000080:2.0:1789297401.194796:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1789297401.194801:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297401.194804:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.194806:0:14443:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:2.0:1789297401.194809:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297401.194812:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.194814:0:14443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:2.0:1789297401.194817:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789297401.194831:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff982b02e44d28) 00000020:00000080:2.0:1789297401.194854:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:2.0:1789297401.194860:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:2.0:1789297401.194862:0:14443:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:2.0:1789297401.194865:0:14443:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:2.0:1789297401.194871:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789297401.194930:0:14443:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b055c7000 from lustre-MDT0000, refs=3 00000020:00000080:2.0:1789297401.194945:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff982b27c48000) 00000020:00000080:2.0:1789297401.194953:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:2.0:1789297401.195009:0:14443:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:2.0:1789297401.195014:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0c47a 00000020:00000080:2.0:1789297401.195226:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:2.0:1789297401.195234:0:14443:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:2.0:1789297401.195251:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x8ad177e823a0c481 00080000:01000000:2.0:1789297401.195256:0:14443:0:(osd_handler.c:1573:osd_obd_connect()) connect #3 00000020:00000080:2.0:1789297401.195260:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0c488 00010000:00010000:2.0:1789297401.251826:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1789297401.252458:0:14443:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967527 00000001:00080000:2.0:1789297401.252643:0:14443:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:2.0:1789297401.253557:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff982b27c499b8) 00000020:00000080:2.0:1789297401.253577:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:2.0:1789297401.253650:0:14443:0:(osd_handler.c:1573:osd_obd_connect()) connect #4 00000020:00000080:2.0:1789297401.253657:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0c496 00000020:00000080:3.0:1789297401.254298:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:3.0:1789297401.264669:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x8ad177e823a0c49d 00000020:00000080:1.0:1789297401.265129:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1789297401.265141:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297401.265147:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.265149:0:14443:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1789297401.265159:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789297401.265165:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.265167:0:14443:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1789297401.265171:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1789297401.265215:0:14443:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1789297401.265229:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297401.265232:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.265234:0:14443:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1789297401.265248:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789297401.265250:0:14443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #10 00000020:01000000:1.0:1789297401.265252:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789297401.265254:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789297401.265255:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789297401.265258:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.265260:0:14443:0:(obd_config.c:1563:class_process_config()) marker 10 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789297401.265262:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789297401.265265:0:14443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789297401.265269:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.265270:0:14443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1789297401.265273:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789297401.265278:0:14443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:1.0:1789297401.265306:0:14443:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789297401.265309:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789297401.265325:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff982b40ca8000) 00000020:00000080:1.0:1789297401.265339:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1789297401.265345:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789297401.265398:0:14443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1789297401.265403:0:14443:0:(osd_handler.c:1573:osd_obd_connect()) connect #5 00000020:00000080:1.0:1789297401.265408:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0c4ab 00010000:00080000:1.0:1789297401.265449:0:14443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982b03eec000@lustre-OST0000-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789297401.265679:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1789297401.266040:0:14443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789297401.266089:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789297401.267014:0:14443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789297401.267084:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1789297401.267157:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1789297401.267466:0:14446:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1789297401.267471:0:14446:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:1.0:1789297401.273106:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1789297401.273193:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1789297401.273234:0:14443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:1.0:1789297401.273266:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0c4b2 00000100:00080000:1.0:1789297401.273276:0:14443:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789297401.273283:0:14443:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982b03eec000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789297401.273320:0:14443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38225c00 x1876213957220352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789297401.273396:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957220352:0@lo:8:llog_process_th.0 00000400:00000100:3.0:1789297401.273455:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876213957220352 offset 0 length 520: 4 00000100:00080000:1.0:1789297401.273522:0:14443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1789297401.273572:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297401.273577:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.273579:0:14443:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1789297401.273582:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1789297401.273585:0:14443:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #16 00000020:01000000:1.0:1789297401.273587:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789297401.273589:0:14443:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1789297401.273591:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1789297401.273594:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.273595:0:14443:0:(obd_config.c:1563:class_process_config()) marker 16 (0x6) lustre sys.timeout 00000020:01000000:1.0:1789297401.273598:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789297401.273602:0:14443:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1789297401.273606:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.273607:0:14443:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1789297401.273610:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1789297401.273614:0:14443:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.202.143@tcp to nid 0x20000c0a8ca8f (192.168.202.143@tcp) 00000020:01000000:1.0:1789297401.273636:0:14443:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1789297401.273646:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789297401.273659:0:14443:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff982b40cab370) 00000020:00000080:1.0:1789297401.273672:0:14443:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1789297401.273677:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1789297401.273753:0:14443:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1789297401.273759:0:14443:0:(osd_handler.c:1573:osd_obd_connect()) connect #6 00000020:00000080:1.0:1789297401.273765:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x8ad177e823a0c4c0 00010000:00080000:1.0:1789297401.273796:0:14443:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982b18041000@lustre-OST0001-osc-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789297401.274198:0:14443:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1789297401.274423:0:14443:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1789297401.274448:0:14443:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1789297401.275413:0:14443:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789297401.275478:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1789297401.275544:0:14443:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:2.0:1789297401.278694:0:14449:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789297401.278727:0:14449:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1789297401.279680:0:14443:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1789297401.279693:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1789297401.281022:0:14443:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1789297401.281050:0:14443:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0c4c7 00000100:00080000:2.0:1789297401.281063:0:14443:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789297401.281070:0:14443:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982b18041000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789297401.281175:0:14443:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b3824a680 x1876213957220480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789297401.281203:0:14443:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1789297401.281435:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297401.281441:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.281443:0:14443:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1789297401.281446:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297401.281451:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.281452:0:14443:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789297401.281455:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789297401.281457:0:14443:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789297401.281460:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297401.281462:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.281463:0:14443:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789297401.281466:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297401.281468:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.281470:0:14443:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789297401.281474:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1789297401.281509:0:14443:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14443:1876213957220608:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297401.281596:0:14443:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.281671:0:14443:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3840 going to sleep for 11 seconds 00000100:00100000:2.0:1789297401.281693:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957220480:0@lo:8:llog_process_th.0 00000400:00000100:2.0:1789297401.281744:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876213957220480 offset 0 length 520: 4 00000100:00100000:3.0:1789297401.282056:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957220608 00000100:00100000:3.0:1789297401.282064:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957220608 00000100:00100000:3.0:1789297401.282212:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1789297401.282223:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14443:x1876213957220608:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297401.282496:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14443:x1876213957220608:12345-0@lo:502:llog_process_th.0 Request processed in 275us (899us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297401.282509:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1789297401.282587:0:14443:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14443:1876213957220608:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1789297401.282615:0:14443:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297401.282621:0:14443:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297401.282623:0:14443:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789297401.282627:0:14443:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:0.0:1789297401.282810:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:0.0:1789297401.282845:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:0.0:1789297401.282867:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256600/0x8ad177e823a0c450 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c457 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.282877:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b38256600/0x8ad177e823a0c450 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c457 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297401.282886:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b055c7000 from 1 10000000:01000000:0.0:1789297401.282889:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789297401.282917:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.282926:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.282936:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297401.282951:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220736:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789297401.282993:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297401.283382:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02f1c0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.283452:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957220736 00000100:00100000:1.0:1789297401.283458:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957220736 00000100:00100000:1.0:1789297401.283486:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789297401.283494:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+9:14407:x1876213957220736:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789297401.283504:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297401.283516:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c4ce expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.283538:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.283549:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 10 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.283557:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3200, rc 0) 00000100:00100000:1.0:1789297401.283632:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+10:14407:x1876213957220736:12345-0@lo:101:mount.lustre.0 Request processed in 139us (639us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.283645:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789297401.283913:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cc000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220736:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297401.283927:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.283936:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297401.284684:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220864:0@lo:256:mount.lustre.0 00000100:00100000:1.0:1789297401.285057:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297401.285135:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c173c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297401.285247:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957220864 00000100:00100000:3.0:1789297401.285254:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957220864 00000100:00100000:3.0:1789297401.285461:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1789297401.285470:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+10:14407:x1876213957220864:12345-0@lo:256:mount.lustre.0 20000000:01000000:3.0:1789297401.285491:0:14419:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:3.0:1789297401.285498:0:14419:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:3.0:1789297401.285585:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+10:14407:x1876213957220864:12345-0@lo:256:mount.lustre.0 Request processed in 117us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297401.285593:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789297401.285661:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220864:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1789297401.286319:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789297401.286353:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.286365:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297401.286374:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b055c7000 from 1 10000000:01000000:2.0:1789297401.286377:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789297401.286417:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.286425:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.286437:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.286456:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220992:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789297401.286495:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.287513:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.287600:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957220992 00000100:00100000:1.0:1789297401.287608:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957220992 00000100:00100000:1.0:1789297401.287651:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1789297401.287661:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+10:14407:x1876213957220992:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789297401.287677:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297401.287696:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c4dc expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.287753:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.287766:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.287776:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3800, rc 0) 00000100:00100000:1.0:1789297401.287828:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14407:x1876213957220992:12345-0@lo:101:mount.lustre.0 Request processed in 169us (1332us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.287835:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789297401.288018:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957220992:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789297401.288033:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.288042:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.288102:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297401.288142:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.288165:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.288330:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957221120 00000100:00100000:1.0:1789297401.288334:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957221120 00000100:00100000:1.0:1789297401.288354:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1789297401.288360:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14407:x1876213957221120:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789297401.288764:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14407:x1876213957221120:12345-0@lo:501:mount.lustre.0 Request processed in 403us (620us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.288777:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1789297401.288942:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221120:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297401.289078:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221248:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297401.289192:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.289223:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b35fe3840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.289279:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957221248 00000100:00100000:1.0:1789297401.289283:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957221248 00000100:00100000:1.0:1789297401.289304:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1789297401.289310:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14407:x1876213957221248:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789297401.289462:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14407:x1876213957221248:12345-0@lo:503:mount.lustre.0 Request processed in 151us (269us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.289468:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1789297401.289545:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221248:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789297401.289886:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14451:1876213957221376:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297401.289923:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297401.289952:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b8ccc0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297401.290186:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957221376 00000100:00100000:2.0:1789297401.290191:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957221376 00000100:00100000:2.0:1789297401.290214:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1789297401.290221:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14451:x1876213957221376:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297401.290487:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14451:x1876213957221376:12345-0@lo:502:llog_process_th.0 Request processed in 266us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297401.290494:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1789297401.290924:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14451:1876213957221376:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1789297401.290953:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789297401.291024:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.291028:0:14451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1789297401.291036:0:14451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b055c7000 00000020:00000080:1.0:1789297401.291039:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789297401.291048:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297401.291050:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.291052:0:14451:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1789297401.291054:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789297401.291056:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.291058:0:14451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1789297401.291061:0:14451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b055c7000 00000020:00000080:1.0:1789297401.291062:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1789297401.291222:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1789297401.291226:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.291228:0:14451:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1789297401.291251:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1789297401.291255:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297401.291256:0:14451:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1789297401.291260:0:14451:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982b055c7000 00000020:00000080:1.0:1789297401.291262:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1789297401.295276:0:14451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14451:1876213957221504:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297401.295365:0:14451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297401.295485:0:14451:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b8ccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297401.300185:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957221504 00000100:00100000:3.0:1789297401.300200:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957221504 00000100:00100000:3.0:1789297401.300276:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1789297401.300288:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14451:x1876213957221504:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1789297401.300553:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14451:x1876213957221504:12345-0@lo:502:llog_process_th.0 Request processed in 268us (5187us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297401.300561:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1789297401.301025:0:14451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14451:1876213957221504:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1789297401.301070:0:14451:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297401.301079:0:14451:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297401.301082:0:14451:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789297401.301087:0:14451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1789297401.301955:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:3.0:1789297401.302204:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789297401.302224:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297401.302246:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297401.302294:0:14407:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1789297401.302298:0:14407:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982b055c7000 10000000:01000000:3.0:1789297401.302305:0:14407:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982b055c7000 10000000:01000000:3.0:1789297401.302310:0:14407:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1789297401.302316:0:14407:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b055c7000 from 1 10000000:01000000:3.0:1789297401.302319:0:14407:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1789297401.302356:0:14407:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148e400/0x8ad177e823a0c4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297401.302366:0:14407:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0148e400/0x8ad177e823a0c4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297401.302376:0:14407:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0148e400/0x8ad177e823a0c4ea lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297401.302399:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221632:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789297401.302458:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297401.302495:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297401.303191:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957221632 00000100:00100000:0.0:1789297401.303201:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957221632 00000100:00100000:0.0:1789297401.303254:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1789297401.303265:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14407:x1876213957221632:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297401.303279:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297401.303292:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bbe00/0x8ad177e823a0c4f1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c4ea expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.303315:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bbe00/0x8ad177e823a0c4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c4ea expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.303327:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bbe00/0x8ad177e823a0c4f1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c4ea expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297401.303335:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bbe00, rc 0) 00000100:00100000:0.0:1789297401.303381:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14407:x1876213957221632:12345-0@lo:101:mount.lustre.0 Request processed in 119us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297401.303394:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789297401.304199:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221632:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789297401.304220:0:14407:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0148e400/0x8ad177e823a0c4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4f1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297401.304231:0:14407:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0148e400/0x8ad177e823a0c4ea lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c4f1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297401.304312:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221760:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297401.304356:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297401.304391:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297401.304945:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957221760 00000100:00100000:0.0:1789297401.304953:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957221760 00000100:00100000:0.0:1789297401.305062:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1789297401.305071:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14407:x1876213957221760:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789297401.306390:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14407:x1876213957221760:12345-0@lo:501:mount.lustre.0 Request processed in 1312us (2026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297401.306402:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1789297401.307062:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221760:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297401.307194:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297401.307261:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.307305:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11da0d80 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.307385:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957221888 00000100:00100000:1.0:1789297401.307391:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957221888 00000100:00100000:1.0:1789297401.307446:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789297401.307456:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14407:x1876213957221888:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789297401.307608:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14407:x1876213957221888:12345-0@lo:503:mount.lustre.0 Request processed in 154us (346us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.307615:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1789297401.307693:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957221888:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297401.315309:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14455:1876213957222016:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297401.315400:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.315490:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b085cd840 going to sleep for 11 seconds 00000100:00100000:0.0:1789297401.322027:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222016 00000100:00100000:0.0:1789297401.322043:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222016 00000100:00100000:1.0:1789297401.322791:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1789297401.322804:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14455:x1876213957222016:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1789297401.323343:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14455:x1876213957222016:12345-0@lo:502:llog_process_th.0 Request processed in 540us (7942us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.323352:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1789297401.324266:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14455:1876213957222016:0@lo:502:llog_process_th.0 00000020:01000004:2.0:1789297401.324346:0:14455:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:2.0:1789297401.324368:0:14455:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff982b27c4b370) 00000020:00000080:2.0:1789297401.324391:0:14455:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:2.0:1789297401.324480:0:14455:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b055c7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789297401.324484:0:14455:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982b055c7000 from lustre-MDT0000, refs=4 00000020:01000004:2.0:1789297401.324486:0:14455:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b055c7000 4 00010000:00080000:2.0:1789297401.324515:0:14455:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982b30f1c000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.202.143@tcp at head 00010000:00010000:2.0:1789297401.330331:0:14455:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:2.0:1789297401.330595:0:14455:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1789297401.330634:0:14455:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1789297401.330648:0:14455:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x8ad177e823a0c4ff 00000100:00080000:2.0:1789297401.330659:0:14455:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1789297401.330666:0:14455:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff982b30f1c000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789297401.330727:0:14455:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38249500 x1876213957222144/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789297401.330749:0:14455:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:1.0:1789297401.332501:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957222144:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789297401.332582:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.333943:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222144 00000100:00100000:2.0:1789297401.333955:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222144 00000100:00100000:2.0:1789297401.334150:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297401.334159:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876213957222144:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789297401.334249:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876213957222144:12345-0@lo:38:llog_process_th.0 Request processed in 78us (1655us total) trans 0 rc -11/-11 00000100:00100000:2.0:1789297401.334257:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297401.334366:0:14455:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14455:1876213957222272:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297401.334419:0:14455:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.334447:0:14455:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b085cd600 going to sleep for 11 seconds 00000100:00100000:2.0:1789297401.334492:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1789297401.334500:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b30f1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1789297401.334504:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1789297401.334513:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957222144:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1789297401.334540:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222272 00000100:00100000:2.0:1789297401.334543:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222272 00000100:00100000:2.0:1789297401.334570:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789297401.334577:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14455:x1876213957222272:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1789297401.334825:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14455:x1876213957222272:12345-0@lo:502:llog_process_th.0 Request processed in 247us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297401.334832:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1789297401.335126:0:14455:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824bb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:930f46ad-32d3-437c-8414-ecdb73298d0c:14455:1876213957222272:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1789297401.335151:0:14455:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:3.0:1789297401.335353:0:14407:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1789297401.335378:0:14407:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1789297401.335403:0:14407:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148e400/0x8ad177e823a0c4ea lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4f1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297401.335422:0:14407:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0148e400/0x8ad177e823a0c4ea lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c4f1 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1789297401.335472:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1789297401.335474:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789297401.335476:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297401.335477:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297401.335478:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297401.335480:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297401.335482:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789297401.335483:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789297401.335485:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297401.335487:0:14407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789297401.335491:0:14407:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:3.0:1789297401.335493:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789297401.335494:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789297401.335495:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297401.335496:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297401.335498:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297401.335499:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297401.335500:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789297401.335501:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789297401.335502:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297401.335503:0:14407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1789297401.335519:0:14407:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:3.0:1789297401.335529:0:14407:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957222400:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789297401.335562:0:14407:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297401.335586:0:14407:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b051e4f00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297401.335603:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222400 00000100:00100000:3.0:1789297401.335607:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222400 00000100:00100000:3.0:1789297401.335636:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789297401.335643:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14407:x1876213957222400:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1789297401.335672:0:14419:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:3.0:1789297401.335690:0:14419:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:3.0:1789297401.384602:0:14419:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1789297401.384651:0:14419:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1789297401.389407:0:14441:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1789297401.389419:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1789297401.389450:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.389471:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.389481:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.389526:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 12 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.389543:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 12 pid: 14419 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.389558:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1876213957222528:0@lo:104: 00000100:00100000:2.0:1789297401.389647:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.389696:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b085cd9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297401.389849:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222528 00000100:00100000:1.0:1789297401.389857:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222528 00000100:00100000:1.0:1789297401.389903:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789297401.389913:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14441:x1876213957222528:12345-0@lo:104: 00010000:00010000:1.0:1789297401.389926:0:14408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.390216:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1789297401.390223:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38249500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14441:x1876213957222528:12345-0@lo:104: Request processed in 312us (576us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297401.390231:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:2.0:1789297401.390311:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297401.390318:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.390327:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297401.390331:0:14414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.390339:0:14414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297401.390347:0:14414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297401.390353:0:14414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789297401.390384:0:14414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.390390:0:14414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297401.390422:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.390430:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c4ce lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c4d5 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.390445:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297401.390447:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297401.390449:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297401.390483:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824bb80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1876213957222528:0@lo:104: 00010000:00010000:2.0:1789297401.390510:0:14441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297401.390571:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957222656:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1789297401.390605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297401.391337:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222656 00000100:00100000:2.0:1789297401.391344:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222656 00010000:00010000:2.0:1789297401.391365:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 13 pid: 14419 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297401.391390:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297401.391397:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+13:3304:x1876213957222656:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297401.391409:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297401.391415:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 13 pid: 14419 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391425:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 13 pid: 14419 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391441:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c4d5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0c4ce expref: 13 pid: 14419 timeout: 513 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391456:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391464:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789297401.391478:0:14410:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002061059s 00010000:00010000:2.0:1789297401.391482:0:14410:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391489:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391503:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391509:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391515:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297401.391519:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.391527:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.391912:0:14441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297401.391923:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 5/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.393311:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.393328:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b38257c00/0x8ad177e823a0c506 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297401.393347:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297401.393435:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+12:3304:x1876213957222656:12345-0@lo:103:ldlm_bl.0 Request processed in 2036us (2826us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297401.393445:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789297401.393531:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957222656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297401.393998:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14407:x1876213957222400:12345-0@lo:253:mount.lustre.0 Request processed in 58354us (58433us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297401.394008:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1789297401.394157:0:14407:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:14407:1876213957222400:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1789297401.394169:0:14407:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:3.0:1789297401.394172:0:14407:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1789297401.394174:0:14407:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:3.0:1789297401.394175:0:14407:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297401.394177:0:14407:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297401.394178:0:14407:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297401.394179:0:14407:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297401.394181:0:14407:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:3.0:1789297401.394182:0:14407:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:3.0:1789297401.394184:0:14407:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297401.394185:0:14407:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1789297401.394196:0:14407:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1789297401.398647:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297401.399035:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1789297401.399400:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297401.399557:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1789297401.403532:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297401.403746:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:3.0:1789297401.404774:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297401.405182:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:3.0:1789297401.405464:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297401.405689:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:3.0:1789297401.406282:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:3.0:1789297401.406445:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1789297401.435353:0:14407:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1789297401.435641:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000020:00080000:1.0:1789297401.435801:0:14463:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:1.0:1789297401.435806:0:14463:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:01000000:1.0:1789297401.436040:0:14464:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:1.0:1789297401.436104:0:14464:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1789297401.440687:0:14464:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:1.0:1789297401.440779:0:14464:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:1.0:1789297401.440784:0:14464:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:2.0:1789297401.441456:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1789297401.441568:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1789297401.442383:0:14407:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1789297401.442394:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1789297401.442548:0:14407:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789297401.444197:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:3.0:1789297401.445168:0:14407:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1789297401.445216:0:14407:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:3.0:1789297401.447415:0:14407:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:3.0:1789297401.453456:0:14407:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:1.0:1789297401.478397:0:14407:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:1.0:1789297401.478433:0:14407:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffb286c1c47988 00100000:10000000:1.0:1789297401.478440:0:14407:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:1.0:1789297401.479007:0:14407:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1789297401.479024:0:14407:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1789297401.479037:0:14407:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=46 00000080:00000004:1.0:1789297401.479065:0:14407:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1789297402.048841:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297402.371045:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 10000000:01000000:0.0:1789297402.813735:0:14422:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1789297402.813743:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b055c7000 from 6 10000000:01000000:0.0:1789297402.813749:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1789297402.813821:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297402.814024:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297402.814038:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297402.814066:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957222784:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1789297402.814142:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297402.814210:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297402.815149:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222784 00000100:00100000:2.0:1789297402.815160:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222784 00000100:00100000:2.0:1789297402.815243:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1789297402.815256:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14422:x1876213957222784:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297402.815272:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297402.815289:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c50d expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297402.815314:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297402.815326:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297402.815335:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257600, rc 0) 00000100:00100000:2.0:1789297402.815405:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957222784:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (1262us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297402.815414:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789297402.815964:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cc000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957222784:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297402.815982:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297402.815992:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297402.816062:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957222912:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1789297402.816106:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297402.816149:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b8cd80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297402.816376:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957222912 00000100:00100000:0.0:1789297402.816383:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957222912 00000100:00100000:0.0:1789297402.816419:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789297402.816427:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957222912:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:0.0:1789297402.816446:0:14417:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1789297402.816464:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1789297402.816468:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:0.0:1789297402.816549:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957222912:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 123us (443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297402.816556:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1789297402.818404:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957222912:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1789297402.818474:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1789297402.818484:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297402.818494:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297403.069824:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1789297403.396263:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789297404.095535:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297405.125406:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297406.143458:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789297406.406380:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789297406.406389:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789297406.406392:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789297406.406395:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789297406.406398:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:0.0:1789297406.406402:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:0.0:1789297406.406406:0:8:0:(import.c:65:import_set_state_nolock()) ffff982b30f1c000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:0.0:1789297406.406418:0:8:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff982b30f1c000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:0.0:1789297406.406444:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b276cfb80 x1876213957223168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789297406.406477:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297406.406495:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957223040:0@lo:400:kworker.0 00000100:00100000:0.0:1789297406.406574:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297406.406657:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957223040 00000100:00100000:0.0:1789297406.406665:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957223040 00000100:00100000:0.0:1789297406.406725:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789297406.406735:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+12:3304:x1876213957223040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297406.406807:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+12:3304:x1876213957223040:12345-0@lo:400:kworker.0 Request processed in 64us (224us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297406.406816:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789297406.406863:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cd180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957223040:0@lo:400:kworker.0 00000100:00100000:1.0:1789297406.409369:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957223168:0@lo:38:kworker.0 00000100:00100000:1.0:1789297406.409460:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297406.409983:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957223168 00000100:00100000:0.0:1789297406.409994:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957223168 00000100:00100000:0.0:1789297406.410077:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297406.410086:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3301:x1876213957223168:12345-0@lo:38:kworker.0 00010000:00080000:0.0:1789297406.410115:0:14427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 418 last 0 00000020:00000080:0.0:1789297406.410156:0:14427:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x8ad177e823a0c51b 00000004:00100000:0.0:1789297406.410173:0:14427:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1789297406.410357:0:14427:0:(import.c:65:import_set_state_nolock()) ffff982b386ab800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1789297406.410438:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3301:x1876213957223168:12345-0@lo:38:kworker.0 Request processed in 351us (977us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297406.410446:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1789297406.410514:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982b276cfb80 x1876213957223168/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789297416 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789297406.410531:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789297406.410541:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:1.0:1789297406.410547:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:1.0:1789297406.410549:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b30f1c000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:1.0:1789297406.410561:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cfb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3301:1876213957223168:0@lo:38:kworker.0 00000001:02000400:0.0:1789297406.700566:0:14707:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1789297407.169420:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297408.203155:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297409.213096:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:1.0:1789297409.816097:0:14858:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffc195677e0 20000000:00000080:1.0:1789297409.816116:0:14858:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982b1f60c000 uarg=0000000000000000 20000000:01000000:1.0:1789297409.816173:0:14858:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:1.0:1789297409.816182:0:14858:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:1.0:1789297409.816188:0:14858:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1789297409.817595:0:14859:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:0.0:1789297409.819334:0:14858:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:0.0:1789297409.834177:0:14858:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:1.0:1789297409.834324:0:14858:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297409.834347:0:14858:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297409.834357:0:14858:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297409.834408:0:14858:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 11 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297409.834423:0:14858:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 11 pid: 14417 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297409.834439:0:14858:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14858:1876213957223296:0@lo:104: 00000100:00100000:1.0:1789297409.834515:0:14858:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297409.835136:0:14858:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11f50d80 going to sleep for 11 seconds 00000100:00100000:0.0:1789297409.836913:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957223296 00000100:00100000:0.0:1789297409.836927:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957223296 00000100:00100000:0.0:1789297409.839126:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297409.839167:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14858:x1876213957223296:12345-0@lo:104: 00010000:00010000:0.0:1789297409.839207:0:14408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297409.839334:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1789297409.839342:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14858:x1876213957223296:12345-0@lo:104: Request processed in 200us (4826us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297409.839350:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:2.0:1789297409.839351:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297409.839360:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.839369:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297409.839373:0:14413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.839394:0:14413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297409.839403:0:14413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297409.839409:0:14413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789297409.839455:0:14413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.839462:0:14413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297409.839498:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.839505:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b38256400/0x8ad177e823a0c4dc lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c4e3 expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.839536:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297409.839538:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297409.839540:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297409.839568:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1789297409.839585:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957223424:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297409.839631:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297409.839757:0:14858:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14858:1876213957223296:0@lo:104: 00010000:00010000:1.0:1789297409.839790:0:14858:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297409.840116:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957223424 00000100:00100000:2.0:1789297409.840124:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957223424 00010000:00010000:2.0:1789297409.840219:0:14411:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 12 pid: 14417 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297409.840294:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297409.840311:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:3303:x1876213957223424:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297409.840324:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297409.840330:0:14411:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 12 pid: 14417 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840341:0:14411:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 12 pid: 14417 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840355:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b3800/0x8ad177e823a0c4e3 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0c4dc expref: 12 pid: 14417 timeout: 521 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840369:0:14411:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840376:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840391:0:14411:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840398:0:14411:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840405:0:14411:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840411:0:14411:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840416:0:14411:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2e00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297409.840419:0:14411:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840434:0:14411:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840455:0:14411:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297409.840465:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297409.840515:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38249c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+11:3303:x1876213957223424:12345-0@lo:103:ldlm_bl.0 Request processed in 206us (883us total) trans 0 rc 0/0 00010000:00010000:1.0:1789297409.840680:0:14858:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297409.840689:0:14858:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297409.840695:0:14858:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b2e00/0x8ad177e823a0c522 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14858 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297409.841654:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297409.841749:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957223424:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297410.239300:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297411.265883:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297411.516796:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789297401/real 1789297401] req@ffff982b3824a680 x1876213957220480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297411 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297411.516830:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982b3824a680 x1876213957220480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297411 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297411.516840:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789297401/real 1789297401] req@ffff982b38225c00 x1876213957220352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297411 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297411.516850:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982b38225c00 x1876213957220352/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297411 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:0.0:1789297411.516868:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789297411.516875:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789297411.516878:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957220480:0@lo:8:llog_process_th.0 00000100:00080000:0.0:1789297411.516884:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b03eec000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1789297411.516888:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:0.0:1789297411.516891:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957220352:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1789297411.517026:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789297411.517031:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1789297411.517034:0:37:0:(import.c:65:import_set_state_nolock()) ffff982b03eec000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789297411.517038:0:37:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1789297411.517042:0:37:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789297411.517047:0:37:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982b03eec000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789297411.517065:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38249f80 x1876213957223680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1789297411.517082:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1789297411.517084:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1789297411.517086:0:37:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1789297411.517088:0:37:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 413 00000100:00080000:2.0:1789297411.517089:0:37:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1789297411.517091:0:37:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982b18041000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:2.0:1789297411.517113:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b3824b800 x1876213957223808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1789297411.517158:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957223936:0@lo:400:kworker.0 00000100:00100000:2.0:1789297411.517222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297411.517302:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957223936 00000100:00100000:2.0:1789297411.517310:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957223936 00000100:00100000:2.0:1789297411.517349:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297411.517355:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957223936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297411.517410:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38248380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957223936:12345-0@lo:400:kworker.0 Request processed in 54us (186us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297411.517418:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1789297411.517461:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982b38248e00 x1876213957223936/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297427 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297411.517474:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957223936:0@lo:400:kworker.0 00000100:00100000:0.0:1789297411.517581:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957223552:0@lo:400:kworker.0 00000100:00100000:0.0:1789297411.517617:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297411.517910:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957223552 00000100:00100000:2.0:1789297411.517915:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957223552 00000100:00100000:2.0:1789297411.517942:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789297411.517946:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+11:3303:x1876213957223552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297411.517977:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+11:3303:x1876213957223552:12345-0@lo:400:kworker.0 Request processed in 31us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297411.517981:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1789297411.518005:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957223552:0@lo:400:kworker.0 00000100:00100000:1.0:1789297411.524213:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957223680:0@lo:8:kworker.0 00000400:00000100:1.0:1789297411.524287:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876213957223680 offset 0 length 520: 4 00000100:00100000:1.0:1789297411.524337:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957223808:0@lo:8:kworker.0 00000400:00000100:1.0:1789297411.524362:0:3301:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1876213957223808 offset 0 length 520: 4 10000000:01000000:1.0:1789297411.773105:0:14422:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789297411.773113:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b055c7000 from 10 10000000:01000000:1.0:1789297411.773119:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789297411.773182:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297411.773195:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297411.773208:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297411.773237:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957224064:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789297411.773313:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297411.773383:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11f50d80 going to sleep for 11 seconds 00000100:00100000:2.0:1789297411.773398:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224064 00000100:00100000:2.0:1789297411.773408:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224064 00000100:00100000:2.0:1789297411.773467:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1789297411.773485:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+11:14422:x1876213957224064:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297411.773502:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297411.773517:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c529 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297411.773542:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297411.773562:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297411.773573:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257e00, rc 0) 00000100:00100000:2.0:1789297411.773627:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957224064:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 143us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297411.773634:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789297411.773651:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957224064:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297411.773671:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297411.773681:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297411.773775:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957224192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297411.773797:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297411.773814:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b0395d540 going to sleep for 11 seconds 00000100:00100000:3.0:1789297411.773832:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224192 00000100:00100000:3.0:1789297411.773839:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224192 00000100:00100000:3.0:1789297411.773970:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1789297411.773979:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957224192:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297411.774272:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957224192:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 295us (473us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297411.774279:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1789297411.774905:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cd180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957224192:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297411.774949:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957224320:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1789297411.775001:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297411.775037:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b385c0000 going to sleep for 11 seconds 00000100:00100000:3.0:1789297411.775151:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224320 00000100:00100000:3.0:1789297411.775158:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224320 00000100:00100000:3.0:1789297411.775285:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1789297411.775294:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957224320:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297411.775480:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:14422:x1876213957224320:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 187us (479us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297411.775487:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1789297411.775577:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957224320:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1789297411.777297:0:14931:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:0.0:1789297411.777481:0:14422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:0.0:1789297411.777507:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1789297411.777520:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297411.777532:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297412.286191:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297413.309758:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297413.631486:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:2.0:1789297414.333613:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1789297414.994597:0:15106:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1789297414.994603:0:15106:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1789297414.994779:0:15106:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982b276e1800 00000020:01000004:1.0:1789297414.994798:0:15106:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:1.0:1789297414.994811:0:15106:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1789297414.994826:0:15106:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff982b40cacd28) 00000020:00000080:1.0:1789297414.994842:0:15106:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789297415.012087:0:15106:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789297415.012382:0:15106:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789297415.013599:0:15106:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789297415.014039:0:15106:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789297415.014292:0:15106:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789297415.014826:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 541: rc = 0 00100000:10000000:2.0:1789297415.014927:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 541: rc = 0 00100000:10000000:2.0:1789297415.015184:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 541: rc = 0 00100000:10000000:2.0:1789297415.015895:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 367: rc = 0 00100000:10000000:2.0:1789297415.016240:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 367: rc = 0 00100000:10000000:2.0:1789297415.016602:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 367: rc = 0 00100000:10000000:2.0:1789297415.016910:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 367: rc = 0 00100000:10000000:2.0:1789297415.017236:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 367: rc = 0 00100000:10000000:2.0:1789297415.017561:0:15106:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 367: rc = 0 00000020:00000080:2.0:1789297415.018376:0:15106:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1789297415.018390:0:15106:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789297415.018403:0:15106:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ad177e823a0c53e 00000020:01000004:2.0:1789297415.018413:0:15106:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1789297415.018515:0:15106:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789297415.018520:0:15106:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789297415.018526:0:15106:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1789297415.018532:0:15106:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1789297415.018545:0:15106:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff982b27c4cd28) 00000020:00000080:2.0:1789297415.018556:0:15106:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:2.0:1789297415.019903:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789297415.020090:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1789297415.020098:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:1.0:1789297415.024140:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:1.0:1789297415.024157:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:1.0:1789297415.024574:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:1.0:1789297415.024581:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1789297415.028324:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1789297415.029186:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1789297415.029194:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1789297415.030160:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1789297415.030169:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1789297415.054632:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789297415.055201:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1789297415.055208:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1789297415.057216:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1789297415.057231:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1789297415.058298:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1789297415.058309:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1789297415.061253:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1789297415.061575:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1789297415.061583:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1789297415.062520:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1789297415.062529:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:2.0:1789297415.116407:0:15106:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1789297415.117044:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:2.0:1789297415.117053:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:2.0:1789297415.127330:0:15106:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:2.0:1789297415.127354:0:15106:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:2.0:1789297415.128264:0:15106:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:2.0:1789297415.128299:0:15106:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:2.0:1789297415.128307:0:15106:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:3.0:1789297415.153499:0:15106:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:3.0:1789297415.153546:0:15106:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.202.143@tcp, index=0000, flags=0x20002 00000020:01000004:3.0:1789297415.153555:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1789297415.153557:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789297415.153558:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297415.153559:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297415.153560:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297415.153561:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297415.153562:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789297415.153563:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297415.153564:0:15106:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789297415.153568:0:15106:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:3.0:1789297415.153570:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1789297415.153571:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:3.0:1789297415.153572:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1789297415.153573:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1789297415.153574:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1789297415.153575:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1789297415.153575:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1789297415.153576:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1789297415.153577:0:15106:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1789297415.153606:0:15106:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:3.0:1789297415.153628:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224448:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1789297415.154033:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297415.154158:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b13b273c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297415.160391:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224448 00000100:00100000:0.0:1789297415.160407:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224448 00000100:00100000:0.0:1789297415.160610:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789297415.160640:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:15106:x1876213957224448:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1789297415.160687:0:14420:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:0.0:1789297415.160723:0:14420:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:0.0:1789297415.160728:0:14420:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:1.0:1789297415.178818:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:15106:x1876213957224448:12345-0@lo:253:mount.lustre.0 Request processed in 18170us (24774us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297415.178835:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1789297415.179167:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224448:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789297415.179183:0:15106:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789297415.179186:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789297415.179188:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789297415.179189:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297415.179190:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297415.179192:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297415.179193:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297415.179267:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789297415.179270:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297415.179271:0:15106:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789297415.179296:0:15106:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982b276e1800 from lustre-OST0000 10000000:01000000:0.0:1789297415.179325:0:15106:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1789297415.179328:0:15106:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1789297415.179335:0:15106:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982b02e419b8 local copy 00010000:00010000:0.0:1789297415.179346:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297415.179671:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224576:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789297415.180385:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297415.180575:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297415.181117:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224576 00000100:00100000:2.0:1789297415.181143:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224576 00000100:00100000:2.0:1789297415.181343:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1789297415.181357:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:15106:x1876213957224576:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297415.182588:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+12:15106:x1876213957224576:12345-0@lo:501:mount.lustre.0 Request processed in 1227us (2199us total) trans 0 rc -2/-2 00000100:00100000:2.0:1789297415.182601:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1789297415.183131:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224576:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789297415.183161:0:15106:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789297415.184346:0:15106:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789297415.184363:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.184388:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297415.185347:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982b276e1800 10000000:01000000:0.0:1789297415.185361:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789297415.185368:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff982b02e419b8 10000000:01000000:0.0:1789297415.185370:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:0.0:1789297415.185374:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff982b02e419b8 from 1 10000000:01000000:0.0:1789297415.185378:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:0.0:1789297415.186101:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb800/0x8ad177e823a0c54c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.186126:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059bb800/0x8ad177e823a0c54c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.186139:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059bb800/0x8ad177e823a0c54c lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297415.187552:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224704:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789297415.187638:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297415.187725:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399edf00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297415.188322:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224704 00000100:00100000:1.0:1789297415.188332:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224704 00000100:00100000:1.0:1789297415.188406:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1789297415.188974:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+12:15106:x1876213957224704:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789297415.188995:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297415.189015:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b2200/0x8ad177e823a0c553 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c54c expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297415.189044:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b2200/0x8ad177e823a0c553 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c54c expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297415.189055:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b2200/0x8ad177e823a0c553 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c54c expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297415.189064:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b2200, rc 0) 00000100:00100000:1.0:1789297415.189156:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+13:15106:x1876213957224704:12345-0@lo:101:mount.lustre.0 Request processed in 742us (1518us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297415.189164:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1789297415.189625:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224704:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789297415.189642:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059bb800/0x8ad177e823a0c54c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c553 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.189652:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059bb800/0x8ad177e823a0c54c lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c553 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297415.189673:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1789297415.189717:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bb800/0x8ad177e823a0c54c lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c553 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.189725:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bb800/0x8ad177e823a0c54c lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c553 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297415.189732:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1789297415.189738:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789297415.189743:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1789297415.189746:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1789297415.189769:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38257200/0x8ad177e823a0c55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.189783:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b38257200/0x8ad177e823a0c55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.189792:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b38257200/0x8ad177e823a0c55a lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297415.189810:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224832:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789297415.189842:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297415.202300:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399edf00 going to sleep for 11 seconds 00000100:00100000:0.0:1789297415.203803:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224832 00000100:00100000:0.0:1789297415.203820:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224832 00000100:00100000:0.0:1789297415.203894:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1789297415.203903:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+13:15106:x1876213957224832:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297415.203921:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297415.203940:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bb400/0x8ad177e823a0c561 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c55a expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.203978:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bb400/0x8ad177e823a0c561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c55a expref: 14 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.204008:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bb400/0x8ad177e823a0c561 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c55a expref: 14 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.204017:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb400, rc 0) 00000100:00100000:0.0:1789297415.204094:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957224832:12345-0@lo:101:mount.lustre.0 Request processed in 192us (14251us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297415.204100:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1789297415.204829:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224832:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789297415.204850:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b38257200/0x8ad177e823a0c55a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c561 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.204860:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b38257200/0x8ad177e823a0c55a lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c561 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789297415.206585:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:2.0:1789297415.212413:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789297415.214603:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:2.0:1789297415.215059:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:2.0:1789297415.215137:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:2.0:1789297415.215271:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:2.0:1789297415.215319:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:2.0:1789297415.215358:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789297415.216052:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789297415.216064:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789297415.218529:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224960:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297415.218605:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297415.218747:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b399ed240 going to sleep for 11 seconds 00000100:00100000:0.0:1789297415.224809:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957224960 00000100:00100000:0.0:1789297415.224825:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957224960 00000100:00100000:2.0:1789297415.231093:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1789297415.231122:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957224960:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297415.231639:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957224960:12345-0@lo:501:mount.lustre.0 Request processed in 532us (13033us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297415.231648:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1789297415.233090:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957224960:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789297415.233172:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225088:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789297415.233316:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297415.233356:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b41d1a0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297415.233824:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225088 00000100:00100000:2.0:1789297415.233832:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225088 00000100:00100000:2.0:1789297415.234213:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1789297415.234226:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957225088:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297415.234643:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957225088:12345-0@lo:503:mount.lustre.0 Request processed in 418us (1326us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297415.234651:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1789297415.235463:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225088:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789297415.238681:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789297415.239298:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225216:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789297415.239405:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297415.240129:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225216 00000100:00100000:1.0:1789297415.240139:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225216 00000100:00100000:1.0:1789297415.240187:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789297415.240208:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957225216:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789297415.240509:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957225216:12345-0@lo:502:mount.lustre.0 Request processed in 313us (1105us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297415.240518:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1789297415.241300:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af540 going to sleep for 11 seconds 00000100:00100000:1.0:1789297415.241335:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225216:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789297415.242126:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1789297415.242283:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1789297415.242327:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1789297415.242377:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1789297415.242414:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1789297415.242536:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1789297415.242588:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1789297415.242623:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1789297415.242657:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1789297415.243141:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1789297415.243190:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1789297415.243350:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1789297415.243409:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225344:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789297415.243571:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297415.243672:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02bc03c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297415.244016:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225344 00000100:00100000:2.0:1789297415.244025:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225344 00000100:00100000:2.0:1789297415.244145:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1789297415.244157:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957225344:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297415.244378:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957225344:12345-0@lo:502:mount.lustre.0 Request processed in 223us (807us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297415.244386:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1789297415.244598:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225344:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789297415.244738:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1789297415.244750:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:1.0:1789297415.246836:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1789297415.247019:0:15120:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:1.0:1789297415.247028:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1789297415.247030:0:15120:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:1.0:1789297415.247036:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1789297415.247062:0:15120:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff982a03318000) 00000020:00000080:1.0:1789297415.247087:0:15120:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:1.0:1789297415.247095:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:1.0:1789297415.247187:0:15120:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b276e1800 from lustre-OST0000, refs=2 00080000:01000000:1.0:1789297415.247271:0:15120:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:1.0:1789297415.247280:0:15120:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x8ad177e823a0c56f 00010000:00010000:1.0:1789297415.253526:0:15120:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:1.0:1789297415.254392:0:15120:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:1.0:1789297415.263101:0:15120:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789297415.270567:0:15120:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:2.0:1789297415.270585:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297415.270591:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297415.270593:0:15120:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:2.0:1789297415.270598:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:2.0:1789297415.270601:0:15120:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:2.0:1789297415.270603:0:15120:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789297415.270604:0:15120:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:2.0:1789297415.270612:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:2.0:1789297415.270616:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297415.270618:0:15120:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:2.0:1789297415.270621:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297415.270625:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297415.270626:0:15120:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789297415.270628:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789297415.270630:0:15120:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789297415.270633:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297415.270635:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297415.270636:0:15120:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789297415.270639:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297415.270641:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297415.270643:0:15120:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789297415.270646:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789297415.270756:0:15120:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297415.270760:0:15120:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297415.270762:0:15120:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789297415.270766:0:15120:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:0.0:1789297415.275488:0:15106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:0.0:1789297415.275545:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1789297415.275572:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38257200/0x8ad177e823a0c55a lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c561 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.275585:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b38257200/0x8ad177e823a0c55a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c561 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297415.275594:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b276e1800 from 1 10000000:01000000:0.0:1789297415.275597:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1789297415.275642:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.275651:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.275671:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297415.275980:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225472:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789297415.276095:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297415.276157:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af840 going to sleep for 11 seconds 00000100:00100000:3.0:1789297415.277002:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225472 00000100:00100000:3.0:1789297415.277018:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225472 00000100:00100000:3.0:1789297415.277079:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1789297415.277091:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+14:15106:x1876213957225472:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789297415.277122:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297415.277142:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c576 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297415.277171:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297415.277183:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 15 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297415.277212:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148ea00, rc 0) 00000100:00100000:3.0:1789297415.277284:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225472:12345-0@lo:101:mount.lustre.0 Request processed in 195us (1189us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297415.277291:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1789297415.277370:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225472:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297415.277386:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.277396:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789297415.279038:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:0.0:1789297415.279493:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297415.279849:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:0.0:1789297415.279934:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:0.0:1789297415.280059:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:0.0:1789297415.280068:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:0.0:1789297415.280148:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789297415.280209:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297415.280302:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297415.280400:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225600 00000100:00100000:1.0:1789297415.280407:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225600 00000100:00100000:1.0:1789297415.280484:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1789297415.280494:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225600:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789297415.280694:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225600:12345-0@lo:501:mount.lustre.0 Request processed in 201us (485us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297415.280723:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1789297415.280805:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225600:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789297415.280836:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225728:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1789297415.280872:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297415.280901:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af840 going to sleep for 11 seconds 00000100:00100000:3.0:1789297415.280966:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225728 00000100:00100000:3.0:1789297415.280971:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225728 00000100:00100000:3.0:1789297415.281001:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1789297415.281008:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4051f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225728:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789297415.281153:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4051f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225728:12345-0@lo:503:mount.lustre.0 Request processed in 146us (280us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297415.281159:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1789297415.281296:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225728:0@lo:503:mount.lustre.0 00000040:00080000:0.0:1789297415.281738:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1789297415.281806:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225856:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789297415.281840:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297415.281868:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af840 going to sleep for 11 seconds 00000100:00100000:2.0:1789297415.281967:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225856 00000100:00100000:2.0:1789297415.281974:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225856 00000100:00100000:2.0:1789297415.282059:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1789297415.282069:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4051d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225856:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297415.282248:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4051d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225856:12345-0@lo:502:mount.lustre.0 Request processed in 180us (406us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297415.282255:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1789297415.282399:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225856:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789297415.282632:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:0.0:1789297415.282677:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:0.0:1789297415.285960:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:0.0:1789297415.286016:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:0.0:1789297415.286043:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:0.0:1789297415.286092:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:0.0:1789297415.286135:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:0.0:1789297415.286166:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:0.0:1789297415.286222:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225984:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789297415.286332:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297415.286379:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b063af840 going to sleep for 11 seconds 00000100:00100000:2.0:1789297415.288224:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957225984 00000100:00100000:2.0:1789297415.288242:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957225984 00000100:00100000:2.0:1789297415.288327:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1789297415.288339:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225984:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297415.288634:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957225984:12345-0@lo:502:mount.lustre.0 Request processed in 297us (2301us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297415.288651:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1789297415.289250:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957225984:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789297415.289451:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1789297415.289467:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:0.0:1789297415.290659:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297415.290672:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297415.290674:0:15124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1789297415.290681:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b276e1800 00000020:00000080:0.0:1789297415.290683:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789297415.290725:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297415.290728:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297415.290730:0:15124:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:0.0:1789297415.290733:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297415.290735:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297415.290736:0:15124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1789297415.290740:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b276e1800 00000020:00000080:0.0:1789297415.290742:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789297415.290818:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297415.290821:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297415.290823:0:15124:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:0.0:1789297415.290826:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1789297415.290829:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297415.290830:0:15124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:0.0:1789297415.290834:0:15124:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982b276e1800 00000020:00000080:0.0:1789297415.290836:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1789297415.290873:0:15124:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1789297415.290888:0:15124:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1789297415.290890:0:15124:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:0.0:1789297415.290894:0:15124:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789297415.291218:0:15106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789297415.291268:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789297415.291302:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.291316:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297415.291360:0:15106:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789297415.291363:0:15106:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982b276e1800 10000000:01000000:2.0:1789297415.291367:0:15106:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982b276e1800 10000000:01000000:2.0:1789297415.291371:0:15106:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789297415.291377:0:15106:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b276e1800 from 1 10000000:01000000:2.0:1789297415.291380:0:15106:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789297415.291416:0:15106:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256a00/0x8ad177e823a0c584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.291425:0:15106:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b38256a00/0x8ad177e823a0c584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.291436:0:15106:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b38256a00/0x8ad177e823a0c584 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297415.291460:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226112:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789297415.291529:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297415.291572:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b08e68600 going to sleep for 11 seconds 00000100:00100000:0.0:1789297415.293822:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957226112 00000100:00100000:0.0:1789297415.293840:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957226112 00000100:00100000:0.0:1789297415.293916:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:0.0:1789297415.293928:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957226112:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297415.294068:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297415.294093:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b059bb000/0x8ad177e823a0c58b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c584 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.294135:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b059bb000/0x8ad177e823a0c58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c584 expref: 16 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.294146:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b059bb000/0x8ad177e823a0c58b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c584 expref: 16 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.294155:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b059bb000, rc 0) 00000100:00100000:0.0:1789297415.294260:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226112:12345-0@lo:101:mount.lustre.0 Request processed in 333us (2729us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297415.294268:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1789297415.294847:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38248700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226112:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789297415.294866:0:15106:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b38256a00/0x8ad177e823a0c584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c58b expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297415.294940:0:15106:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b38256a00/0x8ad177e823a0c584 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c58b expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789297415.297023:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1789297415.297848:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789297415.301148:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:3.0:1789297415.301250:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:3.0:1789297415.301293:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:3.0:1789297415.301344:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:3.0:1789297415.301386:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:3.0:1789297415.301439:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:3.0:1789297415.301496:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:3.0:1789297415.301535:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:3.0:1789297415.301589:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:3.0:1789297415.301634:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:3.0:1789297415.301672:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:3.0:1789297415.301746:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:3.0:1789297415.301778:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:3.0:1789297415.301811:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:3.0:1789297415.301859:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:3.0:1789297415.301896:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:3.0:1789297415.301930:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:3.0:1789297415.301975:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:3.0:1789297415.302008:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:3.0:1789297415.302041:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:3.0:1789297415.302092:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:3.0:1789297415.302174:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:3.0:1789297415.302227:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:3.0:1789297415.302274:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:3.0:1789297415.302310:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:3.0:1789297415.302345:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:3.0:1789297415.302396:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:3.0:1789297415.302430:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:3.0:1789297415.302527:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:3.0:1789297415.302535:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:3.0:1789297415.302656:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297415.302768:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297415.302813:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b13b273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297415.303825:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957226240 00000100:00100000:1.0:1789297415.303835:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957226240 00000100:00100000:1.0:1789297415.309305:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1789297415.309331:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226240:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789297415.309739:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226240:12345-0@lo:501:mount.lustre.0 Request processed in 418us (6970us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297415.309748:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1789297415.309847:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226240:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297415.309920:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226368:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789297415.310144:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297415.310193:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b13b273c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297415.310294:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957226368 00000100:00100000:1.0:1789297415.310301:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957226368 00000100:00100000:1.0:1789297415.310348:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1789297415.310356:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226368:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789297415.310561:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226368:12345-0@lo:503:mount.lustre.0 Request processed in 205us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297415.310569:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1789297415.310831:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226368:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789297415.313538:0:15106:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789297415.313657:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226496:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297415.313773:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297415.313824:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b08e68600 going to sleep for 11 seconds 00000100:00100000:1.0:1789297415.313941:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957226496 00000100:00100000:1.0:1789297415.313949:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957226496 00000100:00100000:1.0:1789297415.314002:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1789297415.314012:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226496:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789297415.315441:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226496:12345-0@lo:502:mount.lustre.0 Request processed in 1425us (1663us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297415.315454:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1789297415.315605:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226496:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789297415.316070:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:2.0:1789297415.316149:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:2.0:1789297415.316186:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:2.0:1789297415.316246:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:2.0:1789297415.316344:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:2.0:1789297415.316407:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:2.0:1789297415.316445:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:2.0:1789297415.316491:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:2.0:1789297415.316540:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:2.0:1789297415.316576:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:2.0:1789297415.316609:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:2.0:1789297415.316658:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:2.0:1789297415.316695:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:2.0:1789297415.316749:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:2.0:1789297415.316795:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:2.0:1789297415.316830:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:2.0:1789297415.316863:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:2.0:1789297415.317162:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:2.0:1789297415.317201:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:2.0:1789297415.317235:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:2.0:1789297415.317487:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:2.0:1789297415.317529:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:2.0:1789297415.317562:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:2.0:1789297415.317624:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:2.0:1789297415.317659:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:2.0:1789297415.318423:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:2.0:1789297415.318510:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:2.0:1789297415.318548:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:2.0:1789297415.318584:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:2.0:1789297415.318631:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:2.0:1789297415.318667:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:2.0:1789297415.319102:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:2.0:1789297415.319158:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:2.0:1789297415.319206:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:2.0:1789297415.319242:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:2.0:1789297415.319425:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:2.0:1789297415.319464:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:2.0:1789297415.319497:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:2.0:1789297415.319540:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:2.0:1789297415.319587:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:2.0:1789297415.319639:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226624:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297415.320633:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297415.320687:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b013f1300 going to sleep for 11 seconds 00000100:00100000:0.0:1789297415.321741:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957226624 00000100:00100000:0.0:1789297415.321766:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957226624 00000100:00100000:0.0:1789297415.321827:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1789297415.321837:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226624:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789297415.323793:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957226624:12345-0@lo:502:mount.lustre.0 Request processed in 1952us (3157us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297415.323806:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1789297415.323815:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957226624:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789297415.324135:0:15106:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:2.0:1789297415.324153:0:15106:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789297415.325661:0:15128:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:1.0:1789297415.325679:0:15128:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff982a0331b370) 00000020:00000080:1.0:1789297415.325700:0:15128:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:1.0:1789297415.330378:0:15128:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b276e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789297415.330391:0:15128:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982b276e1800 from lustre-OST0000, refs=3 00000020:01000004:1.0:1789297415.330394:0:15128:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b276e1800 3 00010000:00080000:1.0:1789297415.330525:0:15128:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a031ce800@lustre-MDT0000-lwp-OST0000: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789297415.335700:0:15128:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:1.0:1789297415.335920:0:15128:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:1.0:1789297415.335958:0:15128:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1789297415.335971:0:15128:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x8ad177e823a0c599 00000100:00080000:1.0:1789297415.335983:0:15128:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1789297415.335989:0:15128:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff982a031ce800 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789297415.336025:0:15128:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38224380 x1876213957226752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789297415.336072:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876213957226752:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1789297415.337343:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1789297415.337399:0:15128:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1789297415.337991:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789297415.337996:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:1.0:1789297415.337999:0:38:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789297415.338002:0:38:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1789297415.338261:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957226880:0@lo:400:kworker.0 00000100:00100000:2.0:1789297415.338325:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297415.338405:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957226752 00000100:00100000:3.0:1789297415.338412:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957226752 00000100:00100000:3.0:1789297415.338514:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957226880 00000100:00100000:3.0:1789297415.338518:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957226880 00000100:00100000:2.0:1789297415.338524:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297415.338531:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876213957226752:12345-0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789297415.338542:0:14426:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1789297415.338549:0:14426:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00010000:00080000:2.0:1789297415.338558:0:14425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 427 last 0 00000020:00000080:2.0:1789297415.338594:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x8ad177e823a0c5a0 00000004:00100000:2.0:1789297415.338610:0:14425:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:2.0:1789297415.338641:0:14425:0:(import.c:65:import_set_state_nolock()) ffff982b06763800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297415.338733:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3301:x1876213957226752:12345-0@lo:38:llog_process_th.0 Request processed in 200us (1393us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297415.338740:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297415.338757:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297415.338763:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957226880:12345-0@lo:400:kworker.0 00010000:00080000:3.0:1789297415.338776:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982b38224380 x1876213957226752/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789297425 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297415.338788:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00100000:2.0:1789297415.338793:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957226880:12345-0@lo:400:kworker.0 Request processed in 32us (468us total) trans 0 rc 0/0 00000100:00080000:3.0:1789297415.338798:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00100000:2.0:1789297415.338799:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:3.0:1789297415.338806:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789297415.338811:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789297415.338814:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982a031ce800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789297415.338820:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3301:1876213957226752:0@lo:38:llog_process_th.0 00010000:00080000:2.0:1789297415.340207:0:3305:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff982b38225f80 x1876213957226880/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297431 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1789297415.340222:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957226880:0@lo:400:kworker.0 00000040:00080000:0.0:1789297415.344944:0:15128:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:0.0:1789297415.348352:0:15106:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:0.0:1789297415.348411:0:15106:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1789297415.349302:0:15106:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256a00/0x8ad177e823a0c584 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c58b expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297415.349320:0:15106:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b38256a00/0x8ad177e823a0c584 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c58b expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1789297415.349395:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1789297415.349397:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789297415.349398:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297415.349400:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297415.349401:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297415.349402:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297415.349404:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789297415.349405:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297415.349407:0:15106:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789297415.349410:0:15106:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:0.0:1789297415.349413:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1789297415.349414:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789297415.349525:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297415.349527:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297415.349528:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297415.349529:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297415.349530:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789297415.349532:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297415.349533:0:15106:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1789297415.349585:0:15106:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1789297415.349606:0:15106:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957227008:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1789297415.349675:0:15106:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297415.349737:0:15106:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05198e40 going to sleep for 11 seconds 00000100:00100000:1.0:1789297415.349956:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227008 00000100:00100000:1.0:1789297415.349964:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227008 00000100:00100000:1.0:1789297415.350024:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1789297415.350034:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15106:x1876213957227008:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789297415.350065:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1789297415.350081:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00010000:00010000:2.0:1789297415.364050:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 20000000:01000000:2.0:1789297415.400180:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789297415.400298:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:1.0:1789297415.400399:0:14441:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789297415.400405:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789297415.400446:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297415.400465:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297415.400475:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297415.400522:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297415.400538:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 16 pid: 14420 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297415.400557:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38226d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1876213957227136:0@lo:104: 00000100:00100000:1.0:1789297415.400636:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297415.400691:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b20d80 going to sleep for 11 seconds 00000100:00100000:3.0:1789297415.400907:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227136 00000100:00100000:3.0:1789297415.400915:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227136 00000100:00100000:3.0:1789297415.400970:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297415.400980:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14441:x1876213957227136:12345-0@lo:104: 00010000:00010000:3.0:1789297415.400994:0:14409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297415.401058:0:14409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1789297415.401065:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14441:x1876213957227136:12345-0@lo:104: Request processed in 87us (430us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297415.401073:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:2.0:1789297415.401144:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297415.401151:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401159:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297415.401163:0:14414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401171:0:14414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297415.401178:0:14414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297415.401207:0:14414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789297415.401248:0:14414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401255:0:14414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297415.401277:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401284:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059ba000/0x8ad177e823a0c50d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c514 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401300:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297415.401302:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297415.401304:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297415.401320:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:930f46ad-32d3-437c-8414-ecdb73298d0c:3302:1876213957227264:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297415.401355:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297415.401403:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227264 00000100:00100000:2.0:1789297415.401407:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227264 00010000:00010000:2.0:1789297415.401607:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 17 pid: 14420 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297415.401638:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297415.401646:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+17:3302:x1876213957227264:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297415.401656:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297415.401661:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 17 pid: 14420 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401671:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 17 pid: 14420 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401697:0:14412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401751:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789297415.401766:0:14412:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002061059s 00010000:00010000:2.0:1789297415.401770:0:14412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401778:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401786:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401793:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401800:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297415.401805:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401812:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401822:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401833:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297415.401866:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+17:3302:x1876213957227264:12345-0@lo:103:ldlm_bl.0 Request processed in 221us (509us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297415.401879:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297415.401916:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:930f46ad-32d3-437c-8414-ecdb73298d0c:3302:1876213957227264:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297415.401945:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b38257600/0x8ad177e823a0c514 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0c50d expref: 16 pid: 14420 timeout: 527 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297415.401955:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38226d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1876213957227136:0@lo:104: 00010000:00010000:2.0:1789297415.401974:0:14441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401983:0:14441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401989:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297415.401995:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b2600/0x8ad177e823a0c5a7 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297415.418044:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+15:15106:x1876213957227008:12345-0@lo:253:mount.lustre.0 Request processed in 67999us (68355us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297415.418079:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1789297415.418278:0:15106:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cd500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15106:1876213957227008:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789297415.418296:0:15106:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1789297415.418300:0:15106:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789297415.418302:0:15106:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1789297415.418303:0:15106:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297415.418304:0:15106:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297415.418306:0:15106:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297415.418307:0:15106:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297415.418308:0:15106:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789297415.418310:0:15106:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297415.418311:0:15106:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1789297415.418329:0:15106:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1789297415.428035:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1789297415.428317:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1789297415.428550:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1789297415.428816:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1789297415.428981:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1789297415.429288:0:15106:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789297415.430344:0:15106:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:3.0:1789297415.499983:0:15106:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:3.0:1789297415.499991:0:15106:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:3.0:1789297415.500025:0:15106:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1789297415.500092:0:15106:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1789297415.500119:0:15106:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=48 00000080:00000004:3.0:1789297415.500149:0:15106:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:2.0:1789297416.381169:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1789297417.340770:0:14422:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789297417.340781:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b055c7000 from 7 10000000:01000000:3.0:1789297417.340786:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789297417.340851:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297417.340864:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297417.340878:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297417.340905:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957227392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789297417.340979:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297417.341287:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11ae5900 going to sleep for 11 seconds 00000100:00100000:2.0:1789297417.341668:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227392 00000100:00100000:2.0:1789297417.341677:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227392 00000100:00100000:2.0:1789297417.341895:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789297417.341905:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+15:14422:x1876213957227392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297417.341923:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297417.341938:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c5ae expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297417.341964:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297417.341975:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 16 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297417.341985:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256000, rc 0) 00000100:00100000:2.0:1789297417.342050:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:14422:x1876213957227392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 147us (1071us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297417.342058:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:2.0:1789297417.342221:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957227392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297417.342239:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297417.342249:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297417.342630:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957227520:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789297417.342675:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297417.342726:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11803780 going to sleep for 11 seconds 00000100:00100000:2.0:1789297417.342741:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227520 00000100:00100000:2.0:1789297417.342746:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227520 00000100:00100000:2.0:1789297417.342781:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789297417.342788:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+16:14422:x1876213957227520:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1789297417.342802:0:14417:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1789297417.342886:0:14417:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1789297417.342890:0:14417:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:2.0:1789297417.342970:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+16:14422:x1876213957227520:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 183us (294us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297417.342978:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:2.0:1789297417.343082:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957227520:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789297417.343153:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789297417.343160:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297417.343169:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297417.405208:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297418.428916:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297419.453010:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297420.477332:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297420.734421:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957227648:0@lo:400:kworker.0 00000100:00100000:1.0:1789297420.734496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1789297420.737285:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789297420.737296:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1789297420.737299:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1789297420.737302:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1789297420.737386:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957227776:0@lo:400:kworker.0 00000100:00100000:3.0:1789297420.737460:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297420.737510:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1789297420.737518:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957227904:0@lo:400:kworker.0 00000100:00100000:3.0:1789297420.737542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297420.737580:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227776 00000100:00100000:3.0:1789297420.737588:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227776 00000100:00100000:3.0:1789297420.737631:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227904 00000100:00100000:3.0:1789297420.737634:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227904 00000100:00100000:1.0:1789297420.741525:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957227648 00000100:00100000:1.0:1789297420.741538:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957227648 00000100:00100000:1.0:1789297420.741581:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789297420.741588:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:3303:x1876213957227648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297420.741682:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:3303:x1876213957227648:12345-0@lo:400:kworker.0 Request processed in 93us (7185us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297420.741689:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1789297420.741761:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957227648:0@lo:400:kworker.0 00000100:00100000:3.0:1789297420.742136:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297420.742147:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957227776:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297420.742202:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957227776:12345-0@lo:400:kworker.0 Request processed in 58us (4741us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297420.742209:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297420.742224:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297420.742231:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957227904:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297420.742262:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957227904:12345-0@lo:400:kworker.0 Request processed in 32us (4719us total) trans 0 rc 0/0 00010000:00080000:1.0:1789297420.742263:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b067b1180 x1876213957227776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297420.742268:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1789297420.742286:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957227776:0@lo:400:kworker.0 00010000:00080000:1.0:1789297420.742307:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b067b2a00 x1876213957227904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297436 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297420.742316:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957227904:0@lo:400:kworker.0 00000100:00080000:3.0:1789297420.742438:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1789297421.514225:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1789297422.026550:0:15476:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1789297422.526397:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297423.549209:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1789297423.876182:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1789297424.576652:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297425.611617:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1789297425.856105:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789297425.856116:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:0.0:1789297425.856119:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:0.0:1789297425.856122:0:8:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1789297425.856177:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957228160:0@lo:400:kworker.0 00000100:00100000:0.0:1789297425.856271:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297425.856341:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1789297425.856348:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957228032:0@lo:400:kworker.0 00000100:00100000:0.0:1789297425.856381:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297425.856436:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957228288:0@lo:400:kworker.0 00000100:00100000:0.0:1789297425.856467:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297425.856504:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228032 00000100:00100000:0.0:1789297425.856514:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228032 00000100:00100000:0.0:1789297425.856567:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789297425.856578:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:3303:x1876213957228032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297425.856646:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:3303:x1876213957228032:12345-0@lo:400:kworker.0 Request processed in 70us (264us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297425.856655:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:0.0:1789297425.856721:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cd500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957228032:0@lo:400:kworker.0 00000100:00100000:3.0:1789297425.857125:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228160 00000100:00100000:3.0:1789297425.857131:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228160 00000100:00100000:3.0:1789297425.857164:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228288 00000100:00100000:3.0:1789297425.857167:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228288 00000100:00100000:3.0:1789297425.857196:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789297425.857202:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957228160:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297425.857248:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cc700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957228160:12345-0@lo:400:kworker.0 Request processed in 46us (977us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297425.857254:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1789297425.857278:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1789297425.857285:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957228288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297425.857318:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957228288:12345-0@lo:400:kworker.0 Request processed in 34us (850us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297425.857324:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1789297425.857347:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1789297425.858127:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b276cf800 x1876213957228288/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297425.858142:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957228288:0@lo:400:kworker.0 00010000:00080000:0.0:1789297425.858170:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b276ce680 x1876213957228160/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297441 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1789297425.858179:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957228160:0@lo:400:kworker.0 00010000:00010000:0.0:1789297426.621769:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297426.626253:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789297411/real 1789297411] req@ffff982b38249f80 x1876213957223680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297426.626299:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982b38249f80 x1876213957223680/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297426.626312:0:3301:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1789297411/real 1789297411] req@ffff982b3824b800 x1876213957223808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297426 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297426.626324:0:3301:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff982b3824b800 x1876213957223808/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1789297426 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1789297426.626347:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b03eec000 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789297426.626380:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789297426.626384:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957223680:0@lo:8:kworker.0 00000100:00080000:3.0:1789297426.626390:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789297426.626394:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:3.0:1789297426.626397:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957223808:0@lo:8:kworker.0 00000100:00080000:1.0:1789297426.627023:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789297426.627029:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1789297426.627033:0:8:0:(import.c:65:import_set_state_nolock()) ffff982b03eec000 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789297426.627040:0:8:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1789297426.627047:0:8:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789297426.627055:0:8:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff982b03eec000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789297426.627081:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38226a00 x1876213957228544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1789297426.627098:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789297426.627101:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789297426.627103:0:8:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789297426.627106:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 423 00000100:00080000:1.0:1789297426.627108:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1789297426.627111:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982b18041000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789297426.627124:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38227b80 x1876213957228672/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1789297426.627365:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297426.627383:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957228416:0@lo:400:kworker.0 00000100:00100000:0.0:1789297426.627468:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297426.628052:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957228544:0@lo:8:kworker.0 00000100:00100000:3.0:1789297426.628097:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297426.628133:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957228672:0@lo:8:kworker.0 00000100:00100000:3.0:1789297426.628166:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297426.628249:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228544 00000100:00100000:3.0:1789297426.628258:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228544 00000100:00100000:3.0:1789297426.628286:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228672 00000100:00100000:3.0:1789297426.628289:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228672 00000100:00100000:3.0:1789297426.628302:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297426.628309:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876213957228544:12345-0@lo:8:kworker.0 00010000:00080000:3.0:1789297426.628335:0:15109:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 438 last 0 00000020:00000080:3.0:1789297426.628364:0:15109:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0c5bc 00002000:00100000:3.0:1789297426.628378:0:15109:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff982b399c9000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:3.0:1789297426.628382:0:15109:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:3.0:1789297426.628385:0:15109:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:3.0:1789297426.628942:0:15109:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1789297426.628966:0:15109:0:(import.c:65:import_set_state_nolock()) ffff982b399cf800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789297426.629039:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3301:x1876213957228544:12345-0@lo:8:kworker.0 Request processed in 727us (938us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297426.629047:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297426.629070:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297426.629075:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876213957228672:12345-0@lo:8:kworker.0 00010000:00020000:3.0:1789297426.629090:0:15109:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:3.0:1789297426.629118:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3301:x1876213957228672:12345-0@lo:8:kworker.0 Request processed in 42us (951us total) trans 0 rc -19/-19 00000100:00100000:3.0:1789297426.629124:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1789297426.629576:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b38226a00 x1876213957228544/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789297446 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297426.629589:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789297426.629845:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1789297426.629854:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1789297426.629873:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:3.0:1789297426.629875:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b03eec000 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1789297426.629907:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1789297426.629913:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957228544:0@lo:8:kworker.0 00000100:00080000:3.0:1789297426.629932:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:3.0:1789297426.629936:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:3.0:1789297426.629939:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957228672:0@lo:8:kworker.0 00000100:00100000:3.0:1789297426.630010:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297426.630023:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957228800:0@lo:400:kworker.0 00000100:00100000:3.0:1789297426.630062:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297426.630102:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228800 00000100:00100000:3.0:1789297426.630107:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228800 00000100:00100000:3.0:1789297426.630140:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789297426.630147:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957228800:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1789297426.630346:0:14447:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:0.0:1789297426.630364:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14447:1876213957229056:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1789297426.630398:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297426.630415:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f783c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297426.630441:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229056 00000100:00100000:0.0:1789297426.630445:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229056 00000100:00100000:0.0:1789297426.630479:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1789297426.630486:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14447:x1876213957229056:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:0.0:1789297426.633089:0:15109:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:0.0:1789297426.633102:0:15109:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:0.0:1789297426.633108:0:15109:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00000100:00100000:3.0:1789297426.634424:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957228800:12345-0@lo:400:kworker.0 Request processed in 4267us (4350us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297426.634436:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789297426.634490:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1789297426.634509:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957228928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297426.634547:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000004:00080000:1.0:1789297426.634839:0:14446:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:1.0:1789297426.635397:0:14446:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 438509691517ns, next at 0ns, rc = 0 00000100:00100000:1.0:1789297426.635439:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228416 00000100:00100000:1.0:1789297426.635449:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228416 00000100:00100000:1.0:1789297426.635505:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1789297426.635514:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+16:3304:x1876213957228416:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297426.635585:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+16:3304:x1876213957228416:12345-0@lo:400:kworker.0 Request processed in 71us (8117us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297426.635591:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00010000:00080000:3.0:1789297426.636525:0:3303:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b38227800 x1876213957228800/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297426.636545:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38227800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957228800:0@lo:400:kworker.0 00000100:00100000:3.0:1789297426.636795:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957228928 00000100:00100000:3.0:1789297426.636802:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957228928 00000100:00080000:0.0:1789297426.657299:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00010000:0.0:1789297426.658059:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.658071:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.658088:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.658093:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.658100:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.658120:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.658131:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.658138:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.662875:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.662912:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1789297426.663305:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297426.663340:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957228928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1789297426.663398:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297426.663529:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957228928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 203us (28980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297426.663538:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297426.663611:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ce680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957228928:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297426.664110:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957228416:0@lo:400:kworker.0 00000100:00100000:3.0:1789297426.664166:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957229184:0@lo:400:kworker.0 00000100:00100000:3.0:1789297426.664204:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297426.664245:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229184 00000100:00100000:3.0:1789297426.664251:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229184 00000100:00100000:3.0:1789297426.664287:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297426.664294:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957229184:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297426.664330:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957229184:12345-0@lo:400:kworker.0 Request processed in 37us (126us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297426.664336:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1789297426.664365:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b38227b80 x1876213957229184/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297442 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297426.664377:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957229184:0@lo:400:kworker.0 00002000:00010000:3.0:1789297426.665082:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789297426.665091:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665110:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1789297426.665121:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297426.665127:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665143:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665155:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665163:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665181:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1789297426.665565:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789297426.665571:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665579:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1789297426.665582:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297426.665587:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665597:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665605:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665619:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.665627:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789297426.666346:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666361:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbc00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.666367:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666376:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666396:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666594:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c5c3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666633:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789297426.666638:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666646:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148fa00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.666649:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666658:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666683:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666689:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000432b0456/0x8ad177e823a0c5ca lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666726:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.666730:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666737:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.666740:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666748:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666758:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666766:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008e26c0f7/0x8ad177e823a0c5d1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.666778:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.666780:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.666787:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.666792:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.666793:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.666795:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1789297426.670472:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1789297426.670490:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.670509:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=438s v=(0 0) 00010000:00010000:3.0:1789297426.670514:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297426.670522:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.670537:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.670550:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.670557:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.671352:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.676371:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.676390:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.676407:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.676412:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.676425:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.676451:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.676460:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000095aa3cc2/0x8ad177e823a0c5d8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.676501:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.676504:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.676506:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297426.682572:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.682587:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.682606:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.682611:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.682617:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.682633:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.682644:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.682653:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.682678:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.683279:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.683288:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.683309:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.683314:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.683325:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.683345:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.683352:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000054c8810c/0x8ad177e823a0c5df lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.683370:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.683372:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.683374:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297426.695094:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.695111:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.695132:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.695137:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.695791:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.695815:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.695825:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.695833:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.695859:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297426.696280:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297426.696288:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.696298:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.696303:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.696325:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.696344:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.696353:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c23418d1/0x8ad177e823a0c5e6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.696372:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.696374:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.696376:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297426.696626:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.696632:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.696641:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.696645:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.696650:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.696671:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.696679:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.696686:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.697302:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297426.697395:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297426.697401:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.697411:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.697415:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.697424:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.697435:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.697454:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000033176471/0x8ad177e823a0c5ed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.697471:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.697473:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.697474:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297426.697793:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.697800:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.697810:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.697814:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.697818:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.697827:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.697835:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.697853:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.700575:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789297426.703576:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.703591:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.703611:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.703616:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.703623:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.703640:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.703651:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.703659:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706020:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789297426.706038:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706055:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3c00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.706061:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706072:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706097:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706106:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004ee625c0/0x8ad177e823a0c5f4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706144:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297426.706149:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706164:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.706167:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.706168:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1789297426.706174:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706183:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706190:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c5fb lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.706205:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.706207:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.706208:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.706808:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297426.709945:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.709959:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.709984:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.709989:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.709996:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710020:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710030:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710038:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710056:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297426.710069:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297426.710074:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710082:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297426.710086:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710096:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710124:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710132:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004cebdc10/0x8ad177e823a0c602 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710151:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.710153:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.710155:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297426.710592:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.710597:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710606:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.710609:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.710613:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710621:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710629:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710637:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710665:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297426.710675:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297426.710679:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710686:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2e00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297426.710690:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710698:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710743:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710750:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009d86162e/0x8ad177e823a0c609 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.710763:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.710765:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.710767:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297426.711179:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297426.713080:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.713105:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=438s v=(0 0) 00010000:00010000:1.0:1789297426.713119:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297426.713126:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.713140:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.713273:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.713286:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.713316:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.713808:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.713816:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.713825:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.713830:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.713851:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.713881:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.713890:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000ce1ed67/0x8ad177e823a0c610 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.713912:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.713914:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.713915:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.720598:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.720615:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.720634:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.720639:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.720646:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.720663:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.720673:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.720689:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.721300:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297426.721325:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297426.721334:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.721343:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbc00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.721348:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.721357:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.721382:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.721389:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c617 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.721407:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.721410:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.721412:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.722854:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.723888:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.723918:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.723923:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.723932:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.723952:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.723963:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.723971:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.724011:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297426.724026:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297426.724033:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.724040:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.724045:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.724054:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.724073:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.724080:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c47f5cb0/0x8ad177e823a0c61e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.724113:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.724115:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.724117:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.728066:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.728083:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.728110:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.728115:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.728122:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.728138:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.728150:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.728158:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.728343:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297426.728351:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.728360:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.728366:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.728375:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.728393:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.728403:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.728405:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.728407:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.728487:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.728493:0:15109:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c625 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1789297426.729392:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.729400:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.729411:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.729415:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.729420:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.729444:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.729453:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.729461:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.729480:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297426.729815:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297426.729823:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.729831:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bae00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297426.729837:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.729855:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.729882:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.729891:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000dfa0fe9/0x8ad177e823a0c62c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297426.729908:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.729909:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297426.729911:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.734170:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.734335:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734354:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.734359:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.734365:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734381:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734392:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734411:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734439:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.734457:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.734464:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734471:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.734476:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734486:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734505:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734513:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c633 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.734534:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.734536:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.734538:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.736236:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.736257:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.736273:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.736278:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.736283:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.736296:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.736306:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.736315:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.736342:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297426.736863:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297426.736881:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.736891:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297426.736895:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.736905:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.736926:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.736945:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000305e344f/0x8ad177e823a0c63a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.736967:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.736969:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.736970:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.737361:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.737369:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737379:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.737383:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.737388:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737399:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737414:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737422:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737436:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.737446:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.737450:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737457:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bb200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.737460:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737469:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737480:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737487:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000007eb7572/0x8ad177e823a0c641 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.737500:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.737506:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.737508:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.740097:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.740109:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740125:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.740130:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.740135:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740148:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740157:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740164:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740254:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1789297426.740733:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.740740:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740751:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.740754:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.740758:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740775:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740784:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740791:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740809:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1789297426.740825:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1789297426.740832:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740839:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.740844:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.740852:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.742739:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.743020:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.743035:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cc8b9e50/0x8ad177e823a0c648 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.743063:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.743065:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.743067:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.745504:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.745521:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745541:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.745546:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.745556:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745573:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745584:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745591:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745614:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.745628:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.745634:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745654:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bbc00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.745659:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745669:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745688:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745705:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000008caca19d/0x8ad177e823a0c656 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.745739:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.745740:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.745742:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.746258:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.746264:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746273:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.746277:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.746281:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746289:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746301:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746308:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746322:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.746330:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.746334:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746340:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.746343:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746351:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746360:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 1/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746367:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e5d06886/0x8ad177e823a0c65d lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746379:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.746385:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.746386:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.746759:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.746765:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746774:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.746777:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.746781:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746790:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746797:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746805:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746818:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.746826:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.746829:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746835:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.746839:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746858:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746869:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746877:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009481c315/0x8ad177e823a0c664 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.746891:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.746893:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.746895:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.747289:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.747295:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747304:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.747307:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.747311:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747318:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747326:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747342:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747367:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297426.747520:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297426.747527:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.747540:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297426.747544:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.747552:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.747565:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.747572:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000078d2edcb/0x8ad177e823a0c66b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.747585:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.747586:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.747587:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.747761:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.747766:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747775:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.747778:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.747781:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747790:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747798:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747805:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747820:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1789297426.747827:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297426.747831:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747843:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00030000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297426.747847:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747855:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747866:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747873:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000619ad563/0x8ad177e823a0c672 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.747886:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.747888:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297426.747889:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.748279:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.748285:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748294:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.748297:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.748301:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748311:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748325:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748333:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748355:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297426.748520:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297426.748525:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748533:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297426.748536:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748544:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748562:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748568:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000032a3e36c/0x8ad177e823a0c679 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748580:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.748582:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.748583:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1789297426.748744:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1789297426.748749:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748757:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=438s v=(0 0) 00010000:00010000:0.0:1789297426.748760:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297426.748764:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748772:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748780:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748788:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297426.748818:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297426.748879:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297426.748883:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748890:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297426.748894:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748902:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748913:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748921:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c27b9d55/0x8ad177e823a0c680 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297426.748956:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.748958:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.748960:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:0.0:1789297426.748977:0:15109:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:3.0:1789297426.758101:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.758108:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297426.758110:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.758158:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.758175:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059ba400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297426.758180:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.758192:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.758214:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.758222:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000adc55be2/0x8ad177e823a0c64f lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297426.758245:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.758247:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297426.758249:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1789297426.758430:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000100:00100000:0.0:1789297426.758680:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14447:x1876213957229056:12345-0@lo:5:osp-pre-0-0.0 Request processed in 128190us (128276us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297426.758693:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1789297426.758852:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14447:1876213957229056:0@lo:5:osp-pre-0-0.0 00000004:00080000:2.0:1789297426.758868:0:14447:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:2.0:1789297426.758916:0:14447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14447:1876213957229312:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1789297426.758954:0:14447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297426.759009:0:14447:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b0c0 going to sleep for 11 seconds 00000100:00100000:2.0:1789297426.759034:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229312 00000100:00100000:2.0:1789297426.759042:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229312 00000100:00100000:2.0:1789297426.759083:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297426.759091:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14447:x1876213957229312:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:2.0:1789297426.759137:0:15110:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:2.0:1789297426.768242:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38248a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14447:x1876213957229312:12345-0@lo:5:osp-pre-0-0.0 Request processed in 9146us (9282us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1789297426.768265:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789297426.775457:0:14447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249880 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14447:1876213957229312:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1789297426.775477:0:14447:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:3.0:1789297427.644882:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297428.669848:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:0.0:1789297429.282256:0:15826:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:0.0:1789297429.282260:0:15826:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:0.0:1789297429.282368:0:15826:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff982b06788000 00000020:01000004:0.0:1789297429.282384:0:15826:0:(tgt_mount.c:2503:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:0.0:1789297429.282398:0:15826:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:0.0:1789297429.282412:0:15826:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff982b40b43370) 00000020:00000080:0.0:1789297429.282427:0:15826:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1789297429.326762:0:15826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1789297429.327098:0:15826:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1789297429.327817:0:15826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1789297429.333324:0:15826:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1789297429.333608:0:15826:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1789297429.335949:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 485: rc = 0 00100000:10000000:2.0:1789297429.336156:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 485: rc = 0 00100000:10000000:2.0:1789297429.336257:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 485: rc = 0 00100000:10000000:2.0:1789297429.336767:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 537: rc = 0 00100000:10000000:2.0:1789297429.337620:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 537: rc = 0 00100000:10000000:2.0:1789297429.338199:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 537: rc = 0 00100000:10000000:2.0:1789297429.338599:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 537: rc = 0 00100000:10000000:2.0:1789297429.339169:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 537: rc = 0 00100000:10000000:2.0:1789297429.340498:0:15826:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 537: rc = 0 00000020:00000080:2.0:1789297429.342602:0:15826:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:2.0:1789297429.342616:0:15826:0:(osd_handler.c:1573:osd_obd_connect()) connect #0 00000020:00000080:2.0:1789297429.342628:0:15826:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ad177e823a0c68e 00000020:01000004:2.0:1789297429.342637:0:15826:0:(tgt_mount.c:2588:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:2.0:1789297429.342660:0:15826:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.202.143@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1789297429.342665:0:15826:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.202.143@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1789297429.342671:0:15826:0:(tgt_mount.c:1812:server_start_targets()) starting target lustre-OST0001 00000020:01000004:2.0:1789297429.342696:0:15826:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:2.0:1789297429.342700:0:15826:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.202.143@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1789297429.363752:0:15826:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.202.143@tcp ctxt 0 is initialized 00000020:01000004:2.0:1789297429.363800:0:15826:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.202.143@tcp, index=0001, flags=0x20002 00000020:01000004:2.0:1789297429.363805:0:15826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1789297429.363810:0:15826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789297429.363811:0:15826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789297429.363813:0:15826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789297429.363814:0:15826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789297429.363815:0:15826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789297429.363816:0:15826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789297429.363818:0:15826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789297429.363819:0:15826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789297429.363823:0:15826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:2.0:1789297429.363825:0:15826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1789297429.363826:0:15826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1789297429.363827:0:15826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1789297429.363828:0:15826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1789297429.363829:0:15826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1789297429.363830:0:15826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1789297429.363830:0:15826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1789297429.363831:0:15826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1789297429.363832:0:15826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1789297429.363857:0:15826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1789297429.363876:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229440:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1789297429.363943:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.369145:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297429.374956:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229440 00000100:00100000:0.0:1789297429.374986:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229440 00000100:00100000:1.0:1789297429.375094:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1789297429.375107:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15826:x1876213957229440:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1789297429.375146:0:14420:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:1.0:1789297429.375150:0:14420:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:1.0:1789297429.375154:0:14420:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:2.0:1789297429.400836:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15826:x1876213957229440:12345-0@lo:253:mount.lustre.0 Request processed in 25722us (36881us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297429.400851:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1789297429.401003:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824b800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229440:0@lo:253:mount.lustre.0 10000000:01000000:0.0:1789297429.401020:0:15826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:0.0:1789297429.401024:0:15826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1789297429.401026:0:15826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:0.0:1789297429.401027:0:15826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1789297429.401029:0:15826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1789297429.401030:0:15826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1789297429.401032:0:15826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1789297429.401033:0:15826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1789297429.401035:0:15826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1789297429.401036:0:15826:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1789297429.401054:0:15826:0:(tgt_mount.c:101:server_register_mount()) register mount ffff982b06788000 from lustre-OST0001 10000000:01000000:0.0:1789297429.401080:0:15826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:0.0:1789297429.401096:0:15826:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789297429.401105:0:15826:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff982b02e419b8 local copy 00010000:00010000:0.0:1789297429.401116:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297429.401352:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229568:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1789297429.401388:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297429.401478:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78c00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.404668:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229568 00000100:00100000:1.0:1789297429.404685:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229568 00000100:00100000:1.0:1789297429.405646:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1789297429.405658:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15826:x1876213957229568:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789297429.406010:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15826:x1876213957229568:12345-0@lo:501:mount.lustre.0 Request processed in 354us (4621us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789297429.406019:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1789297429.406116:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229568:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1789297429.406138:0:15826:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.202.143@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1789297429.406307:0:15826:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.202.143@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1789297429.406317:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297429.406328:0:15826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b059bba00/0x8ad177e823a0c434 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c43b expref: -99 pid: 14407 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1789297429.406357:0:15826:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff982b06788000 10000000:01000000:0.0:1789297429.406363:0:15826:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1789297429.406368:0:15826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1789297429.406371:0:15826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1789297429.406376:0:15826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1789297429.406379:0:15826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1789297429.406408:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0c695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297429.406417:0:15826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0c695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297429.406438:0:15826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0c695 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297429.406468:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229696:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1789297429.406503:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.413348:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982a02f78c00 going to sleep for 11 seconds 00000100:00100000:3.0:1789297429.413432:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229696 00000100:00100000:3.0:1789297429.413442:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229696 00000100:00100000:3.0:1789297429.413642:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1789297429.413652:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+16:15826:x1876213957229696:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789297429.413669:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297429.413686:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0148fe00/0x8ad177e823a0c69c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c695 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297429.413728:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0148fe00/0x8ad177e823a0c69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c695 expref: 17 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297429.413740:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0148fe00/0x8ad177e823a0c69c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c695 expref: 17 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297429.413750:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fe00, rc 0) 00000100:00100000:3.0:1789297429.413818:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957229696:12345-0@lo:101:mount.lustre.0 Request processed in 168us (7314us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.413825:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1789297429.413915:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229696:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297429.413933:0:15826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0c695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c69c expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297429.413944:0:15826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0c695 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c69c expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789297429.414785:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1789297429.415832:0:15826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297429.416096:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1789297429.416142:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1789297429.416175:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1789297429.416222:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1789297429.416261:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:0.0:1789297429.416295:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:2.0:1789297429.421043:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:2.0:1789297429.421067:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:2.0:1789297429.421195:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297429.421269:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.421308:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b480 going to sleep for 11 seconds 00000100:00100000:3.0:1789297429.424759:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229824 00000100:00100000:3.0:1789297429.424790:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229824 00000100:00100000:3.0:1789297429.424886:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1789297429.424896:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957229824:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297429.425418:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957229824:12345-0@lo:501:mount.lustre.0 Request processed in 523us (4148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.425427:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1789297429.425524:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229824:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297429.425675:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229952:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297429.425761:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.425910:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.425993:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957229952 00000100:00100000:1.0:1789297429.425998:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957229952 00000100:00100000:1.0:1789297429.426024:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1789297429.426032:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957229952:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789297429.426319:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957229952:12345-0@lo:503:mount.lustre.0 Request processed in 286us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.426326:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1789297429.426413:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957229952:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789297429.427076:0:15826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789297429.427144:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230080:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297429.427185:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.427208:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.427274:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230080 00000100:00100000:1.0:1789297429.427280:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230080 00000100:00100000:1.0:1789297429.427302:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1789297429.427308:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957230080:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789297429.427528:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957230080:12345-0@lo:502:mount.lustre.0 Request processed in 219us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.427536:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1789297429.427758:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230080:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789297429.427997:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1789297429.428044:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1789297429.428077:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1789297429.428126:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1789297429.428164:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1789297429.428200:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1789297429.428262:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1789297429.428301:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1789297429.428347:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1789297429.428373:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230208:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297429.428413:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.428446:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b480 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.428564:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230208 00000100:00100000:1.0:1789297429.428633:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230208 00000100:00100000:1.0:1789297429.428669:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:1.0:1789297429.428677:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957230208:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789297429.428854:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957230208:12345-0@lo:502:mount.lustre.0 Request processed in 177us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.428861:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1789297429.428988:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230208:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789297429.429050:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1789297429.429059:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:2.0:1789297429.429888:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1789297429.429897:0:15827:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:2.0:1789297429.429903:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.429906:0:15827:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:2.0:1789297429.429919:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1789297429.429942:0:15827:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff982a010c0000) 00000020:00000080:2.0:1789297429.429964:0:15827:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:2.0:1789297429.429969:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1789297429.430055:0:15827:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b06788000 from lustre-OST0001, refs=2 00080000:01000000:2.0:1789297429.430063:0:15827:0:(osd_handler.c:1573:osd_obd_connect()) connect #1 00000020:00000080:2.0:1789297429.430079:0:15827:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x8ad177e823a0c6aa 00010000:00010000:2.0:1789297429.434214:0:15827:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:2.0:1789297429.434950:0:15827:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:2.0:1789297429.436869:0:15827:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:2.0:1789297429.438261:0:15827:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:2.0:1789297429.438273:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297429.438279:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.438281:0:15827:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:2.0:1789297429.438285:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297429.438289:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.438290:0:15827:0:(obd_config.c:1563:class_process_config()) marker 23 (0x1) lustre sys.timeout 00000020:00000080:2.0:1789297429.438293:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1789297429.438295:0:15827:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1789297429.438297:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297429.438299:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.438300:0:15827:0:(obd_config.c:1563:class_process_config()) marker 23 (0x2) lustre sys.timeout 00000020:01000000:2.0:1789297429.438302:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297429.438304:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.438305:0:15827:0:(obd_config.c:1563:class_process_config()) marker 27 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1789297429.438308:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:2.0:1789297429.438352:0:15827:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297429.438356:0:15827:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.438357:0:15827:0:(obd_config.c:1563:class_process_config()) marker 27 (0x2) lustre sys.jobid_var 00000040:00080000:2.0:1789297429.438361:0:15827:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:3.0:1789297429.438569:0:15826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:3.0:1789297429.438604:0:15826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:3.0:1789297429.438626:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0c695 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c69c expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297429.438638:0:15826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b00030400/0x8ad177e823a0c695 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c69c expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1789297429.438646:0:15826:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b06788000 from 1 10000000:01000000:3.0:1789297429.438649:0:15826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1789297429.438684:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297429.438693:0:15826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297429.438728:0:15826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297429.438754:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230336:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1789297429.438823:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297429.438866:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11803780 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.438994:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230336 00000100:00100000:1.0:1789297429.439002:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230336 00000100:00100000:1.0:1789297429.439048:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1789297429.439058:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+17:15826:x1876213957230336:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1789297429.439071:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297429.439083:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c6b1 expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.439108:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 18 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.439118:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 18 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.439126:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b382b3200, rc 0) 00000100:00100000:1.0:1789297429.439165:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230336:12345-0@lo:101:mount.lustre.0 Request processed in 108us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.439172:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1789297429.439305:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230336:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1789297429.439325:0:15826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297429.439335:0:15826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1789297429.439915:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:3.0:1789297429.440939:0:15826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1789297429.441197:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:3.0:1789297429.441243:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:3.0:1789297429.441303:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:3.0:1789297429.441312:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:3.0:1789297429.441381:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297429.441433:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297429.441647:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11803780 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.443987:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230464 00000100:00100000:1.0:1789297429.443998:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230464 00000100:00100000:1.0:1789297429.444096:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1789297429.444106:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230464:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1789297429.444408:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230464:12345-0@lo:501:mount.lustre.0 Request processed in 303us (2973us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.444416:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1789297429.446197:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230464:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297429.446261:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230592:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789297429.446325:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297429.449353:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11803780 going to sleep for 11 seconds 00000100:00100000:0.0:1789297429.449416:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230592 00000100:00100000:0.0:1789297429.449425:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230592 00000100:00100000:0.0:1789297429.449534:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789297429.449545:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230592:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1789297429.450237:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230592:12345-0@lo:503:mount.lustre.0 Request processed in 691us (3909us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.450247:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1789297429.450519:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230592:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789297429.451344:0:15826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789297429.451418:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230720:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297429.451544:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.451676:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b240 going to sleep for 11 seconds 00000100:00100000:3.0:1789297429.451829:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230720 00000100:00100000:3.0:1789297429.451836:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230720 00000100:00100000:3.0:1789297429.451982:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:3.0:1789297429.451993:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230720:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1789297429.452199:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06254c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230720:12345-0@lo:502:mount.lustre.0 Request processed in 208us (656us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.452212:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1789297429.452283:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230720:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789297429.452535:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:2.0:1789297429.452598:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:2.0:1789297429.452665:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:2.0:1789297429.452733:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:2.0:1789297429.452773:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:2.0:1789297429.452834:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:2.0:1789297429.452887:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:2.0:1789297429.452922:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:2.0:1789297429.452951:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230848:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297429.453007:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.453451:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b240 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.453581:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230848 00000100:00100000:1.0:1789297429.453587:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230848 00000100:00100000:1.0:1789297429.453618:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1789297429.453625:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230848:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789297429.453813:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06255450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230848:12345-0@lo:502:mount.lustre.0 Request processed in 187us (804us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.453820:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1789297429.454002:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230848:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1789297429.454110:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:2.0:1789297429.454122:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:2.0:1789297429.455194:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297429.455207:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.455211:0:15831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1789297429.455219:0:15831:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b06788000 00000020:00000080:2.0:1789297429.455222:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789297429.455228:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297429.455231:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.455232:0:15831:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:2.0:1789297429.455234:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297429.455236:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.455238:0:15831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:2.0:1789297429.455241:0:15831:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff982b06788000 00000020:00000080:2.0:1789297429.455243:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789297429.455303:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297429.455313:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.455314:0:15831:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:2.0:1789297429.455317:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1789297429.455320:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.455321:0:15831:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1789297429.455324:0:15831:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff982b06788000 00000020:00000080:2.0:1789297429.455326:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1789297429.455363:0:15831:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1789297429.455366:0:15831:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1789297429.455368:0:15831:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:2.0:1789297429.455371:0:15831:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1789297429.456784:0:15826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1789297429.456818:0:15826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1789297429.456945:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.456962:0:15826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297429.457833:0:15826:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1789297429.457838:0:15826:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff982b06788000 10000000:01000000:2.0:1789297429.457842:0:15826:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff982b06788000 10000000:01000000:2.0:1789297429.457846:0:15826:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1789297429.458103:0:15826:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff982b06788000 from 1 10000000:01000000:2.0:1789297429.458106:0:15826:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1789297429.458147:0:15826:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256c00/0x8ad177e823a0c6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.458158:0:15826:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b38256c00/0x8ad177e823a0c6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.458169:0:15826:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b38256c00/0x8ad177e823a0c6bf lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297429.458205:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230976:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1789297429.458275:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.458318:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297429.458555:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957230976 00000100:00100000:0.0:1789297429.458563:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957230976 00000100:00100000:0.0:1789297429.458681:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1789297429.458690:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957230976:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1789297429.458726:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297429.458741:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00031e00/0x8ad177e823a0c6c6 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c6bf expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297429.458765:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031e00/0x8ad177e823a0c6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c6bf expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297429.458775:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00031e00/0x8ad177e823a0c6c6 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c6bf expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297429.458783:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031e00, rc 0) 00000100:00100000:0.0:1789297429.458830:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06256450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957230976:12345-0@lo:101:mount.lustre.0 Request processed in 142us (556us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297429.458837:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1789297429.459665:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957230976:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1789297429.459683:0:15826:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b38256c00/0x8ad177e823a0c6bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6c6 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.459692:0:15826:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b38256c00/0x8ad177e823a0c6bf lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c6c6 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1789297429.463044:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1789297429.463452:0:15826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1789297429.463794:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1789297429.463839:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1789297429.463872:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1789297429.463920:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1789297429.463956:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1789297429.464031:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1789297429.464081:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1789297429.464116:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1789297429.464164:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1789297429.464202:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1789297429.464236:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1789297429.464281:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1789297429.464318:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1789297429.464356:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1789297429.464404:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1789297429.464440:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1789297429.464471:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1789297429.464526:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1789297429.464557:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1789297429.464588:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1789297429.464633:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1789297429.464670:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1789297429.464742:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1789297429.464787:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1789297429.464823:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1789297429.464854:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1789297429.464901:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1789297429.464939:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1789297429.464991:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1789297429.465054:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1789297429.465093:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1789297429.465129:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1789297429.465164:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1789297429.465214:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1789297429.465249:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1789297429.465294:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1789297429.465329:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1789297429.465401:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1789297429.465409:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000100:00100000:2.0:1789297429.465500:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297429.465567:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.465611:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297429.465755:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957231104 00000100:00100000:3.0:1789297429.465763:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957231104 00000100:00100000:3.0:1789297429.465810:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1789297429.465819:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231104:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1789297429.466049:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06254450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231104:12345-0@lo:501:mount.lustre.0 Request processed in 231us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.466057:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1789297429.466404:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231104:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1789297429.466441:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231232:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1789297429.468349:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.468400:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b0c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.468522:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957231232 00000100:00100000:1.0:1789297429.468533:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957231232 00000100:00100000:1.0:1789297429.468684:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1789297429.468694:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231232:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1789297429.469184:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06256850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231232:12345-0@lo:503:mount.lustre.0 Request processed in 491us (839us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.469193:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1789297429.472779:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231232:0@lo:503:mount.lustre.0 00000040:00080000:2.0:1789297429.475261:0:15826:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:2.0:1789297429.475348:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231360:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297429.475421:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297429.476639:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957231360 00000100:00100000:0.0:1789297429.476650:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957231360 00000100:00100000:0.0:1789297429.476727:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:0.0:1789297429.476738:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231360:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1789297429.477212:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b0c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297429.477303:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06254050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231360:12345-0@lo:502:mount.lustre.0 Request processed in 566us (1881us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297429.477311:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1789297429.477670:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231360:0@lo:502:mount.lustre.0 00000040:00080000:0.0:1789297429.480265:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:0.0:1789297429.480351:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:0.0:1789297429.480389:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:0.0:1789297429.480451:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:0.0:1789297429.480970:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:0.0:1789297429.481036:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:0.0:1789297429.481083:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:0.0:1789297429.481117:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:0.0:1789297429.481166:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:0.0:1789297429.481204:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:0.0:1789297429.481239:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:0.0:1789297429.481286:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:0.0:1789297429.481323:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:0.0:1789297429.481360:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:0.0:1789297429.481409:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:0.0:1789297429.481448:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:0.0:1789297429.482038:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:0.0:1789297429.482113:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:0.0:1789297429.482151:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:0.0:1789297429.482186:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:0.0:1789297429.482235:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:0.0:1789297429.482272:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:0.0:1789297429.482308:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:0.0:1789297429.482357:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:0.0:1789297429.482396:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:0.0:1789297429.482430:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:0.0:1789297429.482543:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:0.0:1789297429.482653:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:0.0:1789297429.482692:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:0.0:1789297429.482768:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:0.0:1789297429.482806:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:0.0:1789297429.482841:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:0.0:1789297429.482946:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:0.0:1789297429.483026:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:0.0:1789297429.483061:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:0.0:1789297429.483108:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:0.0:1789297429.483144:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:0.0:1789297429.483178:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:0.0:1789297429.483231:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:0.0:1789297429.483287:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:0.0:1789297429.483344:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231488:0@lo:502:mount.lustre.0 00000100:00100000:0.0:1789297429.483427:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297429.483568:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957231488 00000100:00100000:1.0:1789297429.483587:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957231488 00000100:00100000:1.0:1789297429.483638:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789297429.483647:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231488:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1789297429.487424:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06255850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957231488:12345-0@lo:502:mount.lustre.0 Request processed in 3768us (3988us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.487436:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:1.0:1789297429.493029:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11ae5840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.493075:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdc00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957231488:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1789297429.493418:0:15826:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1789297429.493439:0:15826:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:1.0:1789297429.495426:0:15836:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:1.0:1789297429.495443:0:15836:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff982a0331cd28) 00000020:00000080:1.0:1789297429.495466:0:15836:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:1.0:1789297429.495657:0:15836:0:(tgt_mount.c:153:server_get_mount()) get mount ffff982b06788000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789297429.495661:0:15836:0:(tgt_mount.c:187:server_put_mount()) put mount ffff982b06788000 from lustre-OST0001, refs=3 00000020:01000004:1.0:1789297429.495663:0:15836:0:(obd_mount.c:710:lustre_put_lsi()) put ffff982b06788000 3 00010000:00080000:1.0:1789297429.495694:0:15836:0:(ldlm_lib.c:102:import_set_conn()) imp ffff982a01cf2000@lustre-MDT0000-lwp-OST0001: add connection 192.168.202.143@tcp at head 00010000:00010000:1.0:1789297429.498226:0:15836:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:3.0:1789297429.501129:0:15836:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:3.0:1789297429.501172:0:15836:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:3.0:1789297429.501186:0:15836:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x8ad177e823a0c6d4 00000100:00080000:3.0:1789297429.501197:0:15836:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1789297429.501203:0:15836:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff982a01cf2000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:3.0:1789297429.501252:0:15836:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b067b0e00 x1876213957231616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1789297429.501287:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957231616:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1789297429.501354:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297429.501418:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957231616 00000100:00100000:3.0:1789297429.501426:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957231616 00000100:00100000:3.0:1789297429.501677:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1789297429.501687:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3301:x1876213957231616:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1789297429.501736:0:14425:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 441 last 0 00000020:00000080:3.0:1789297429.501778:0:14425:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x8ad177e823a0c6db 00000004:00100000:3.0:1789297429.501793:0:14425:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1789297429.501825:0:14425:0:(import.c:65:import_set_state_nolock()) ffff982b276e5800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789297429.501942:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3301:x1876213957231616:12345-0@lo:38:llog_process_th.0 Request processed in 255us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.501951:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1789297429.502003:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b067b0e00 x1876213957231616/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1789297439 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297429.502014:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:3.0:1789297429.502021:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:3.0:1789297429.502028:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1789297429.502033:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1789297429.502035:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982a01cf2000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1789297429.502042:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3301:1876213957231616:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1789297429.502063:0:15836:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000040:00080000:3.0:1789297429.503005:0:15836:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00080000:1.0:1789297429.503816:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789297429.503821:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789297429.503824:0:8:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789297429.503830:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 438 00000100:00080000:1.0:1789297429.503833:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:1.0:1789297429.503838:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982b18041000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789297429.503909:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38226d80 x1876213957231872/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000020:01000000:1.0:1789297429.504048:0:15826:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1789297429.504080:0:15826:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1789297429.504093:0:15826:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38256c00/0x8ad177e823a0c6bf lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6c6 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.504101:0:15826:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b38256c00/0x8ad177e823a0c6bf lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6c6 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1789297429.504263:0:15826:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1789297429.504265:0:15826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789297429.504268:0:15826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297429.504269:0:15826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297429.504270:0:15826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297429.504271:0:15826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297429.504272:0:15826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789297429.504273:0:15826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297429.504273:0:15826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789297429.504277:0:15826:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:1.0:1789297429.504278:0:15826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1789297429.504279:0:15826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789297429.504279:0:15826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297429.504280:0:15826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297429.504281:0:15826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297429.504281:0:15826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297429.504282:0:15826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789297429.504282:0:15826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297429.504283:0:15826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1789297429.504294:0:15826:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1789297429.504306:0:15826:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957232256:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789297429.504360:0:15826:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297429.504385:0:15826:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c730c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297429.504398:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957231744:0@lo:400:kworker.0 00000100:00100000:1.0:1789297429.504420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297429.504444:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957231872:0@lo:8:kworker.0 00000100:00100000:1.0:1789297429.504457:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297429.504472:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957232000:0@lo:400:kworker.0 00000100:00100000:1.0:1789297429.504486:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297429.504498:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297429.504500:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957232128:0@lo:400:kworker.0 00000100:00100000:1.0:1789297429.504510:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297429.504533:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957231744 00000100:00100000:1.0:1789297429.504538:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957231744 00000100:00100000:1.0:1789297429.504575:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957231872 00000100:00100000:1.0:1789297429.504632:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957231872 00000100:00100000:1.0:1789297429.504645:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1789297429.504651:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876213957231744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297429.504690:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:3305:x1876213957231744:12345-0@lo:400:kworker.0 Request processed in 39us (268us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.504692:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232256 00000100:00100000:1.0:1789297429.504696:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1789297429.504699:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232256 00000100:00100000:1.0:1789297429.504730:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1789297429.504734:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876213957231872:12345-0@lo:8:kworker.0 00000100:00100000:3.0:1789297429.504749:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1789297429.504759:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:15826:x1876213957232256:12345-0@lo:253:mount.lustre.0 00000100:00100000:1.0:1789297429.504766:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876213957231872:12345-0@lo:8:kworker.0 Request processed in 29us (305us total) trans 0 rc -11/-11 00000100:00100000:1.0:1789297429.504771:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 20000000:01000000:3.0:1789297429.504782:0:14417:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 00000100:00100000:1.0:1789297429.504791:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232000 20000000:01000000:3.0:1789297429.504796:0:14417:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1789297429.504797:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232000 00000100:00100000:1.0:1789297429.504822:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232128 00000100:00100000:1.0:1789297429.504826:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232128 00000100:00100000:1.0:1789297429.504996:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789297429.505005:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957232000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297429.505039:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3302:x1876213957232000:12345-0@lo:400:kworker.0 Request processed in 37us (551us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.505047:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1789297429.505061:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1789297429.505067:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957232128:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297429.505094:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3302:x1876213957232128:12345-0@lo:400:kworker.0 Request processed in 28us (582us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297429.505100:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789297429.505114:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789297429.505175:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297429.505206:0:3301:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1789297429.505211:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1789297429.505214:0:3301:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1789297429.505216:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957231872:0@lo:8:kworker.0 00000100:00100000:1.0:1789297429.505236:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957231744:0@lo:400:kworker.0 00010000:00080000:1.0:1789297429.505250:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b38224380 x1876213957232128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297429.505256:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3302:1876213957232128:0@lo:400:kworker.0 00010000:00080000:1.0:1789297429.505261:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff982b38225f80 x1876213957232000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297445 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297429.505266:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3302:1876213957232000:0@lo:400:kworker.0 20000000:01000000:2.0:1789297429.584116:0:14417:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1789297429.584135:0:14417:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:1.0:1789297429.584193:0:14441:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:1.0:1789297429.584198:0:14441:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:1.0:1789297429.584221:0:14441:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.584240:0:14441:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.584248:0:14441:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.584289:0:14441:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297429.584303:0:14441:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 19 pid: 14420 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297429.584341:0:14441:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1876213957232384:0@lo:104: 00000100:00100000:1.0:1789297429.584413:0:14441:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297429.584478:0:14441:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c73180 going to sleep for 11 seconds 00000100:00100000:2.0:1789297429.584610:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232384 00000100:00100000:2.0:1789297429.584618:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232384 00000100:00100000:2.0:1789297429.584668:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297429.584678:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14441:x1876213957232384:12345-0@lo:104: 00010000:00010000:2.0:1789297429.584693:0:14408:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.584770:0:14408:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789297429.584776:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:930f46ad-32d3-437c-8414-ecdb73298d0c+3:14441:x1876213957232384:12345-0@lo:104: Request processed in 100us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297429.584784:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1789297429.584808:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297429.584814:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.584821:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148e000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297429.584825:0:14413:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.584834:0:14413:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297429.584853:0:14413:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297429.584859:0:14413:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1789297429.584892:0:14413:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.584898:0:14413:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297429.584919:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.584927:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c5ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c5b5 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.584950:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297429.584952:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297429.584953:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297429.584965:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957232512:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297429.585004:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297429.585041:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232512 00000100:00100000:2.0:1789297429.585045:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232512 00010000:00010000:2.0:1789297429.585061:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 20 pid: 14420 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297429.585081:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297429.585087:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+20:3304:x1876213957232512:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297429.585097:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297429.585103:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 20 pid: 14420 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585119:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 20 pid: 14420 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585138:0:14412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585147:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1789297429.585159:0:14412:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002061059s 00010000:00010000:2.0:1789297429.585164:0:14412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585172:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585179:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585186:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585192:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297429.585196:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585204:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585213:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585228:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297429.585254:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38248700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+20:3304:x1876213957232512:12345-0@lo:103:ldlm_bl.0 Request processed in 167us (250us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297429.585261:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297429.585292:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957232512:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297429.585323:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b38256000/0x8ad177e823a0c5b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0c5ae expref: 19 pid: 14420 timeout: 541 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297429.585333:0:14441:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14441:1876213957232384:0@lo:104: 00010000:00010000:2.0:1789297429.585346:0:14441:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585354:0:14441:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585360:0:14441:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297429.585366:0:14441:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b2000/0x8ad177e823a0c6e2 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14441 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297429.600033:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06257450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:15826:x1876213957232256:12345-0@lo:253:mount.lustre.0 Request processed in 95265us (95660us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297429.600047:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1789297429.600156:0:15826:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:930f46ad-32d3-437c-8414-ecdb73298d0c:15826:1876213957232256:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1789297429.600171:0:15826:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1789297429.600174:0:15826:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1789297429.600176:0:15826:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1789297429.600177:0:15826:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1789297429.600179:0:15826:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1789297429.600180:0:15826:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1789297429.600182:0:15826:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1789297429.600183:0:15826:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1789297429.600185:0:15826:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1789297429.600186:0:15826:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1789297429.600204:0:15826:0:(tgt_mount.c:2695:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1789297429.608946:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297429.609169:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1789297429.609328:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297429.609475:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1789297429.609633:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1789297429.609881:0:15826:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1789297429.612993:0:15826:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:2.0:1789297429.694694:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1789297429.724225:0:15826:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1789297429.724236:0:15826:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1789297429.724276:0:15826:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1789297429.724345:0:15826:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.202.143@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1789297429.724360:0:15826:0:(tgt_mount.c:2461:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1789297429.724427:0:15826:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 10000000:01000000:3.0:1789297430.654064:0:14422:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:3.0:1789297430.654075:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff982b055c7000 from 8 10000000:01000000:3.0:1789297430.654081:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1789297430.654135:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c6e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297430.654165:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c6e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297430.654177:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c6e9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297430.654204:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957232640:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1789297430.654280:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297430.654348:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07361b40 going to sleep for 11 seconds 00000100:00100000:2.0:1789297430.654408:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232640 00000100:00100000:2.0:1789297430.654416:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232640 00000100:00100000:2.0:1789297430.654475:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789297430.654486:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+18:14422:x1876213957232640:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297430.654503:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297430.654517:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b38256000/0x8ad177e823a0c6f0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c6e9 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297430.654542:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b38256000/0x8ad177e823a0c6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c6e9 expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297430.654553:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b38256000/0x8ad177e823a0c6f0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c6e9 expref: 19 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297430.654576:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256000, rc 0) 00000100:00100000:2.0:1789297430.654619:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b06257c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957232640:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 135us (338us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297430.654626:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1789297430.654673:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b0e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957232640:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1789297430.654687:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c6e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6f0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297430.654696:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c6e9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c6f0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297430.654782:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957232768:0@lo:256:ll_cfg_requeue.0 00000100:00100000:2.0:1789297430.654815:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297430.654841:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b07b4b0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1789297430.655077:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232768 00000100:00100000:3.0:1789297430.655082:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232768 00000100:00100000:3.0:1789297430.655118:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1789297430.655126:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957232768:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1789297430.655140:0:14419:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1789297430.655156:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1789297430.655160:0:14419:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:3.0:1789297430.655244:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41eff450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957232768:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 118us (427us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297430.655252:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1789297430.655322:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38249f80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957232768:0@lo:256:ll_cfg_requeue.0 10000000:01000000:2.0:1789297430.655380:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1789297430.655387:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c6e9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6f0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297430.655396:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0148e000/0x8ad177e823a0c6e9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c6f0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297430.718039:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1789297431.084313:0:6712:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000001:00100000:0.0:1789297431.084336:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00010000:00010000:1.0:1789297431.742210:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297431.998284:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957232896:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1789297431.998364:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297431.999084:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957232896 00000100:00100000:0.0:1789297431.999095:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957232896 00000100:00100000:0.0:1789297431.999168:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297431.999177:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957232896:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297431.999223:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297431.999297:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38249f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957232896:12345-0@lo:13:osp-pre-0-0.0 Request processed in 120us (932us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297431.999304:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297431.999340:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1789297431.999363:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957232896:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789297432.001288:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1789297432.764923:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1789297433.085342:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1789297433.788985:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789297434.556849:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1789297434.556857:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1789297434.556860:0:8:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1789297434.556877:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff982b18041000 using connection 192.168.202.143@tcp/0@lo 00000100:00100000:1.0:1789297434.556902:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff982b38226d80 x1876213957233280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1789297434.556985:0:3301:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957233280:0@lo:8:kworker.0 00000100:00100000:1.0:1789297434.557055:0:3301:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297434.557129:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957233408:0@lo:400:kworker.0 00000100:00100000:1.0:1789297434.557168:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297434.557195:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1789297434.557201:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957233536:0@lo:400:kworker.0 00000100:00100000:1.0:1789297434.557222:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297434.557264:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233280 00000100:00100000:1.0:1789297434.557271:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233280 00000100:00100000:1.0:1789297434.557304:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789297434.557311:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3301:x1876213957233280:12345-0@lo:8:kworker.0 00010000:00080000:1.0:1789297434.557338:0:15107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 446 last 0 00000020:00000080:1.0:1789297434.557369:0:15107:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x8ad177e823a0c6f7 00002000:00100000:1.0:1789297434.557383:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff982a01cf6000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211396c ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:1.0:1789297434.557388:0:15107:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:1.0:1789297434.557390:0:15107:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1789297434.557749:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1789297434.557774:0:15107:0:(import.c:65:import_set_state_nolock()) ffff982a01cf7000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789297434.557825:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3301:x1876213957233280:12345-0@lo:8:kworker.0 Request processed in 512us (769us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297434.557833:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789297434.557856:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233408 00000100:00100000:1.0:1789297434.557860:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233408 00000100:00100000:1.0:1789297434.557887:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233536 00000100:00100000:1.0:1789297434.557890:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233536 00000100:00100000:1.0:1789297434.557919:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789297434.557937:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957233408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297434.557977:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957233408:12345-0@lo:400:kworker.0 Request processed in 52us (808us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297434.557984:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1789297434.558017:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297434.558025:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957233536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297434.558055:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957233536:12345-0@lo:400:kworker.0 Request processed in 32us (832us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297434.558061:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1789297434.558088:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1789297434.558117:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b38227b80 x1876213957233536/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297434.558132:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38227b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957233536:0@lo:400:kworker.0 00010000:00080000:1.0:1789297434.558144:0:3304:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b38225f80 x1876213957233408/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1789297434.558153:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957233408:0@lo:400:kworker.0 00010000:00080000:1.0:1789297434.558186:0:3301:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b38226d80 x1876213957233280/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1789297459 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1789297434.558196:0:3301:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:1.0:1789297434.558203:0:3301:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:1.0:1789297434.558208:0:3301:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:1.0:1789297434.558210:0:3301:0:(import.c:65:import_set_state_nolock()) ffff982b18041000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:1.0:1789297434.558229:0:3301:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:1.0:1789297434.558235:0:3301:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38226d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3301:1876213957233280:0@lo:8:kworker.0 00000004:00080000:1.0:1789297434.558268:0:14450:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:1.0:1789297434.558282:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1876213957233920:0@lo:5:osp-pre-1-0.0 00000100:00100000:1.0:1789297434.558310:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297434.558327:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b0395d300 going to sleep for 11 seconds 00000100:00100000:1.0:1789297434.558346:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233920 00000100:00100000:1.0:1789297434.558350:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233920 00000100:00100000:1.0:1789297434.558378:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297434.558385:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14450:x1876213957233920:12345-0@lo:5:osp-pre-1-0.0 00000100:00100000:3.0:1789297434.560216:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:930f46ad-32d3-437c-8414-ecdb73298d0c:3302:1876213957233024:0@lo:400:kworker.0 00000100:00100000:3.0:1789297434.560295:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297434.560339:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957233664:0@lo:400:kworker.0 00000100:00100000:3.0:1789297434.560366:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297434.560395:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:3.0:1789297434.560401:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957233152:0@lo:400:kworker.0 00000100:00100000:3.0:1789297434.560437:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297434.560458:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957233792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297434.560480:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297434.560520:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233024 00000100:00100000:3.0:1789297434.560538:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233024 00000100:00100000:3.0:1789297434.560583:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789297434.560591:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3302:x1876213957233024:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297434.560644:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41efec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3302:x1876213957233024:12345-0@lo:400:kworker.0 Request processed in 54us (349us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297434.560651:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1789297434.560682:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233792 00000100:00100000:3.0:1789297434.560685:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233792 00000100:00100000:3.0:1789297434.560749:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297434.560757:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957233792:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297434.560785:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297434.560819:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3302:x1876213957233792:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297434.560825:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1789297434.560848:0:15110:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789297434.560855:0:15110:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1789297434.561027:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233664 00000100:00100000:3.0:1789297434.561032:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233664 00000100:00100000:3.0:1789297434.561067:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789297434.561074:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957233664:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297434.561110:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957233664:12345-0@lo:400:kworker.0 Request processed in 36us (742us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297434.561116:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:3.0:1789297434.561163:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982a0299c000 x1876213957233792/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1789297450 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297434.561185:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957233792:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297434.561195:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38224e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:930f46ad-32d3-437c-8414-ecdb73298d0c:3302:1876213957233024:0@lo:400:kworker.0 00010000:00080000:3.0:1789297434.561205:0:3302:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff982b38225180 x1876213957233664/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1789297450 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1789297434.561212:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38225180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957233664:0@lo:400:kworker.0 00000100:00100000:3.0:1789297434.561256:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957233152 00000100:00100000:3.0:1789297434.561259:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957233152 00000100:00100000:3.0:1789297434.561280:0:15110:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1789297434.561287:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297434.561293:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957233152:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297434.561329:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957233152:12345-0@lo:400:kworker.0 Request processed in 36us (891us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297434.561335:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1789297434.561359:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957233152:0@lo:400:kworker.0 00000004:00080000:2.0:1789297434.561747:0:14449:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1789297434.562188:0:14449:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 446436483448ns, next at 0ns, rc = 0 00002000:00080000:1.0:1789297434.563662:0:15109:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:1.0:1789297434.563673:0:15109:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:1.0:1789297434.563677:0:15109:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:1.0:1789297434.571342:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789297434.571350:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789297434.571353:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:1.0:1789297434.571973:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.571984:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572001:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.572006:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.572012:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572031:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572042:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572050:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572083:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297434.572097:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.572103:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572110:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.572115:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572124:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572140:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572147:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000ce1ed67/0x8ad177e823a0c6fe lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.572164:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.572166:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.572167:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.573073:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.573080:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.573090:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.573099:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.573104:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.573114:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.573123:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.573130:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.573141:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297434.574181:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.574190:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.574200:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.574205:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.574215:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.574233:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.574318:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c705 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.574341:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.574343:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.574345:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.575329:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.575337:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575350:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.575354:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.575360:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575371:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575379:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575393:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575413:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297434.575424:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.575429:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575435:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3c00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.575439:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575446:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575458:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575464:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004ee625c0/0x8ad177e823a0c70c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.575476:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.575478:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.575480:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.578662:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.578686:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578718:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.578723:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.578843:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578862:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578872:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578880:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578904:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297434.578923:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.578937:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578945:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.578950:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578958:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578979:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.578986:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c23418d1/0x8ad177e823a0c713 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.579005:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.579007:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.579008:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.579581:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.579587:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.579595:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.579599:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.579603:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.579612:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.579619:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.579625:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.579652:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789297434.580908:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.580916:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.580937:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.580940:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.580944:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.580955:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.580962:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.580969:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.580988:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789297434.581003:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789297434.581009:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581016:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.581026:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581035:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581050:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581057:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000054c8810c/0x8ad177e823a0c71a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581074:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.581077:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581083:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2e00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.581086:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581092:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581101:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581107:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000009d86162e/0x8ad177e823a0c721 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581126:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.581127:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.581129:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.581679:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.581686:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.581696:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.581699:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.581726:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.582117:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.582421:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.582432:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.582440:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.582462:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297434.584905:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.584918:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.584940:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.584945:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.584955:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.584975:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.584982:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004cebdc10/0x8ad177e823a0c728 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.585007:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.585009:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.585019:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.588429:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.588441:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588469:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.588473:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.588479:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588494:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588505:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588512:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588538:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297434.588552:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.588557:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588566:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.588570:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588580:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588609:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588618:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000951e0ad4/0x8ad177e823a0c72f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.588639:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.588641:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.588643:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.590195:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.590205:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.590220:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.590224:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.590230:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.592443:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.592459:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.592468:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.593071:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297434.593434:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297434.593442:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.593452:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297434.593456:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.593466:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.593495:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.593501:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000067804207/0x8ad177e823a0c736 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.593521:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297434.593522:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297434.593581:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.595610:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.595621:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.595637:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.595641:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.595647:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.595660:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.595668:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.595675:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.595690:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297434.596918:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.596937:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.596950:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b3000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.596954:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.596964:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.596982:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.596989:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000621c47ae/0x8ad177e823a0c73d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.597009:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.597011:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.597013:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.597854:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.597863:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.597875:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.597885:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.597891:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.597905:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.597913:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.597920:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.597952:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789297434.598437:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.598443:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.598453:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.598456:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.598460:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.598470:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.598478:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.598491:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.598511:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789297434.598660:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789297434.598666:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598673:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.598677:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598696:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598724:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598742:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000edb5f3f5/0x8ad177e823a0c744 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598780:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.598784:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598790:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.598793:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598800:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598810:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598816:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008366d86e/0x8ad177e823a0c74b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.598841:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.598842:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.598844:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.599399:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.606538:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.606550:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.606569:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.606573:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.606580:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.606595:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.606607:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.606616:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.606633:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789297434.607087:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.607101:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607109:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.607112:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.607117:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607126:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607140:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607147:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607164:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789297434.607174:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789297434.607180:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607188:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.607193:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607202:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607225:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607302:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000062f7a5aa/0x8ad177e823a0c752 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607321:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.607325:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607332:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.607335:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607342:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607353:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607361:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000189b6063/0x8ad177e823a0c759 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.607373:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.607374:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.607380:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.607682:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.612615:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.612630:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612648:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.612652:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.612659:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612672:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612682:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612690:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612728:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297434.612745:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.612751:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612759:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.612765:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612787:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612804:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612812:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004783f6ec/0x8ad177e823a0c760 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.612830:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.612831:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.612833:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.613265:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.613271:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613280:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.613283:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.613288:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613297:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613305:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613317:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613331:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1789297434.613339:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.613343:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613350:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a000 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.613354:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613362:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613373:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613380:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001b61ee3a/0x8ad177e823a0c767 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613393:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.613395:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.613396:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.613739:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.613751:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613760:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.613763:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.613768:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613777:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613785:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613793:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.613807:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789297434.614196:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.614202:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614210:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.614213:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.614217:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614227:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614241:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614247:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614260:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1789297434.614270:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1789297434.614275:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614281:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.614285:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614293:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614305:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614313:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000002be42f2/0x8ad177e823a0c76e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614330:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.614339:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614346:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152a200 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297434.614349:0:14414:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614356:0:14414:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614409:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614417:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000c1e6216/0x8ad177e823a0c775 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614429:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.614430:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.614432:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297434.614878:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.614884:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614893:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.614897:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.614901:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.614921:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.616665:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.616824:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.616836:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.616858:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1789297434.617845:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1789297434.617855:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.617872:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=446s v=(0 0) 00010000:00010000:1.0:1789297434.617877:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297434.617883:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.617899:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.617913:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.617944:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.617953:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297434.617962:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297434.621969:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.621991:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.621997:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622009:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622032:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622041:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a15012af/0x8ad177e823a0c77c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622066:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.622071:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622093:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152aa00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.622096:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622103:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622114:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622120:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004de96928/0x8ad177e823a0c783 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.622136:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.622138:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.622140:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789297434.623621:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297434.623632:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.623648:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789297434.623653:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297434.623659:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.623673:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.623689:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.623696:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297434.623966:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.626562:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1789297434.626582:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.626589:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.626604:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.626609:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.626620:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.626642:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 1/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.626651:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c78a lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.626669:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.626676:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.626678:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789297434.628467:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297434.628480:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.628496:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789297434.628500:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297434.628506:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.628519:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.628527:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.628617:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.628700:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297434.628784:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297434.628790:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.628798:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297434.628803:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.628812:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.628827:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.628834:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0c791 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297434.628860:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297434.628862:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297434.628864:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789297434.629395:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297434.629400:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.629406:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789297434.629409:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297434.629412:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.629423:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.629429:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.629433:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.629444:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789297434.630994:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297434.631003:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631015:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789297434.631019:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297434.631022:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631030:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631036:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631050:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631061:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789297434.631070:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789297434.631074:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631079:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.631082:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631088:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631099:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631103:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000187b22aa/0x8ad177e823a0c798 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631114:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.631116:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631126:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.631128:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631132:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631137:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 1/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631141:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000a657cb6f/0x8ad177e823a0c79f lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.631148:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.631149:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.631150:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297434.631480:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789297434.634750:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297434.634761:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.634779:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789297434.634784:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297434.634790:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.634805:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.634822:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.634829:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.634844:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1789297434.635270:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297434.635276:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635284:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789297434.635287:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297434.635291:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635301:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635308:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635314:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635340:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:2.0:1789297434.635355:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789297434.635361:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635368:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.635372:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635382:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635397:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635404:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0c7a6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635418:0:14413:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297434.635420:0:14413:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635426:0:14413:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297434.635428:0:14413:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635445:0:14413:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635454:0:14413:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 1/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635460:0:14413:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000743faf6a/0x8ad177e823a0c7ad lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635471:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.635472:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297434.635474:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1789297434.635903:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1789297434.635909:0:15109:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635917:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=446s v=(0 0) 00010000:00010000:2.0:1789297434.635920:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297434.635934:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635944:0:15109:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635952:0:15109:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635969:0:15109:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297434.635986:0:15109:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00080000:2.0:1789297434.636150:0:15109:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:2.0:1789297434.636253:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14450:x1876213957233920:12345-0@lo:5:osp-pre-1-0.0 Request processed in 77863us (77937us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297434.636263:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1789297434.636510:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1789297434.636516:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297434.636536:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297434.636547:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297434.636557:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297434.636570:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297434.636578:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fa5e39d1/0x8ad177e823a0c7b4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297434.636594:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297434.636596:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297434.636597:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1789297434.636753:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297434.637778:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299e680 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1876213957233920:0@lo:5:osp-pre-1-0.0 00000004:00080000:2.0:1789297434.637793:0:14450:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00000100:00100000:2.0:1789297434.637836:0:14450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1876213957234048:0@lo:5:osp-pre-1-0.0 00000100:00100000:2.0:1789297434.637882:0:14450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297434.637918:0:14450:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304900 going to sleep for 11 seconds 00000100:00100000:3.0:1789297434.637990:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234048 00000100:00100000:3.0:1789297434.637996:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234048 00000100:00100000:3.0:1789297434.638045:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297434.638053:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:14450:x1876213957234048:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:3.0:1789297434.638094:0:15110:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000004:00080000:3.0:1789297434.646829:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00000100:00100000:3.0:1789297434.648031:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:14450:x1876213957234048:12345-0@lo:5:osp-pre-1-0.0 Request processed in 9972us (10141us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1789297434.648043:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1789297434.648099:0:14450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38248e00 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14450:1876213957234048:0@lo:5:osp-pre-1-0.0 00000004:00080000:3.0:1789297434.648114:0:14450:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00010000:00010000:0.0:1789297434.813695:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1789297435.194168:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1789297435.194196:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00010000:00010000:0.0:1789297435.841683:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789297435.893303:0:16187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg243-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1789297436.861857:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297437.116995:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297437.117030:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957234176:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297437.117109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297437.117881:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234176 00000100:00100000:0.0:1789297437.117890:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234176 00000100:00100000:0.0:1789297437.118005:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1789297437.118026:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957234176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297437.118070:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297437.118144:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957234176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 129us (1034us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297437.118151:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1789297437.118291:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957234176:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1789297437.118361:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789297437.692403:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.693789:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121152 00000100:00100000:1.0:1789297437.693804:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121152 00000100:00100000:1.0:1789297437.693864:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:1.0:1789297437.693875:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2352:x1876213933121152:12345-192.168.202.43@tcp:250:mount.lustre.0 00010000:00080000:1.0:1789297437.693916:0:14420:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 79a19869-c943-4bb1-ae55-8dacb3e6d501@192.168.202.43@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1789297437.693949:0:14420:0:(genops.c:1385:class_connect()) connect: client 79a19869-c943-4bb1-ae55-8dacb3e6d501, cookie 0x8ad177e823a0c7bb 00000100:00080000:1.0:1789297437.694204:0:14420:0:(import.c:65:import_set_state_nolock()) ffff982a01cf3000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789297437.695175:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41630050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+5:2352:x1876213933121152:12345-192.168.202.43@tcp:250:mount.lustre.0 Request processed in 1296us (2779us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.695185:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 75 00000100:00100000:2.0:1789297437.707135:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297437.709408:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121280 00000100:00100000:3.0:1789297437.709424:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121280 00000100:00100000:3.0:1789297437.709524:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:3.0:1789297437.709536:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+5:13779:x1876213933121280:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789297437.709556:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297437.709579:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0148e800/0x8ad177e823a0c7c2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dcc6 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297437.709961:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0148e800/0x8ad177e823a0c7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcc6 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297437.709973:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0148e800/0x8ad177e823a0c7c2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcc6 expref: 6 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297437.709981:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e800, rc 0) 00000100:00100000:3.0:1789297437.710150:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+6:13779:x1876213933121280:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 615us (3023us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.710157:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 76 00000100:00100000:0.0:1789297437.732216:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.732379:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121408 00000100:00100000:1.0:1789297437.732390:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121408 00000100:00100000:1.0:1789297437.732449:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:1.0:1789297437.732460:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+6:13779:x1876213933121408:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:1.0:1789297437.733173:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+6:13779:x1876213933121408:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 711us (966us total) trans 0 rc -2/-2 00000100:00100000:1.0:1789297437.733190:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 77 00000100:00100000:2.0:1789297437.739166:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297437.741228:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121536 00000100:00100000:0.0:1789297437.741258:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121536 00000100:00100000:0.0:1789297437.741337:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:0.0:1789297437.741348:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+6:13779:x1876213933121536:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789297437.741367:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297437.741386:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00031800/0x8ad177e823a0c7c9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dccd expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297437.741421:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031800/0x8ad177e823a0c7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dccd expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297437.741434:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00031800/0x8ad177e823a0c7c9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dccd expref: 7 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297437.741444:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031800, rc 0) 00000100:00100000:0.0:1789297437.741529:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+7:13779:x1876213933121536:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 181us (2375us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297437.741536:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 78 00000100:00100000:2.0:1789297437.757663:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297437.757855:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121664 00000100:00100000:3.0:1789297437.757868:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121664 00000100:00100000:3.0:1789297437.757947:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:3.0:1789297437.757959:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+7:13779:x1876213933121664:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789297437.758305:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13779:x1876213933121664:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 346us (651us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.758313:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 79 00000100:00100000:2.0:1789297437.763995:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.764097:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121792 00000100:00100000:1.0:1789297437.764108:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121792 00000100:00100000:1.0:1789297437.764166:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:1.0:1789297437.764177:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13779:x1876213933121792:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:1.0:1789297437.764608:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41630c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13779:x1876213933121792:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 431us (623us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.764623:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 80 00000100:00100000:2.0:1789297437.772219:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297437.773152:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933121920 00000100:00100000:3.0:1789297437.773167:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933121920 00000100:00100000:3.0:1789297437.773228:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:3.0:1789297437.773239:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13797:x1876213933121920:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789297437.773674:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13797:x1876213933121920:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 435us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.773682:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 81 00000100:00100000:2.0:1789297437.797584:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297437.797811:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122048 00000100:00100000:3.0:1789297437.797837:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122048 00000100:00100000:3.0:1789297437.797924:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:3.0:1789297437.797935:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13797:x1876213933122048:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789297437.798228:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13797:x1876213933122048:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 294us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.798236:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 82 00000100:00100000:2.0:1789297437.806510:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.806631:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122176 00000100:00100000:1.0:1789297437.806645:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122176 00000100:00100000:1.0:1789297437.806738:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:1.0:1789297437.806750:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+8:13779:x1876213933122176:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789297437.806772:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297437.806793:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152a000/0x8ad177e823a0c7d0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dcf7 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297437.806828:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152a000/0x8ad177e823a0c7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcf7 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297437.806840:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152a000/0x8ad177e823a0c7d0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcf7 expref: 9 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297437.806863:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a000, rc 0) 00000100:00100000:1.0:1789297437.806934:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41633850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+9:13779:x1876213933122176:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 186us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.806941:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 83 00000100:00100000:2.0:1789297437.813250:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297437.816268:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122304 00000100:00100000:0.0:1789297437.816287:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122304 00000100:00100000:0.0:1789297437.816362:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:0.0:1789297437.816372:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+9:13779:x1876213933122304:12345-192.168.202.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789297437.816398:0:14419:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789297437.816424:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789297437.816429:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789297437.816432:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789297437.816434:0:14419:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:0.0:1789297437.835140:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41632050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+9:13779:x1876213933122304:12345-192.168.202.43@tcp:256:mount.lustre.0 Request processed in 18758us (21891us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297437.835170:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 84 00000100:00100000:2.0:1789297437.839576:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.839833:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122432 00000100:00100000:1.0:1789297437.839845:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122432 00000100:00100000:1.0:1789297437.839917:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:1.0:1789297437.839928:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+9:13779:x1876213933122432:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:1.0:1789297437.839950:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297437.839970:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dcfe expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297437.840005:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297437.840018:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 10 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297437.840028:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b400, rc 0) 00000100:00100000:1.0:1789297437.840088:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41632c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13779:x1876213933122432:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 162us (523us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.840095:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 85 00000100:00100000:2.0:1789297437.847822:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297437.848045:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122560 00000100:00100000:0.0:1789297437.848056:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122560 00000100:00100000:0.0:1789297437.848116:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00100000:0.0:1789297437.848126:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13779:x1876213933122560:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:0.0:1789297437.848539:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41630850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13779:x1876213933122560:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 413us (728us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297437.848547:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 86 00000100:00100000:2.0:1789297437.851247:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297437.851385:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122688 00000100:00100000:3.0:1789297437.851396:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122688 00000100:00100000:3.0:1789297437.851507:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:3.0:1789297437.851518:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13779:x1876213933122688:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789297437.852068:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41631050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13779:x1876213933122688:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 549us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.852076:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 87 00000100:00100000:2.0:1789297437.855359:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.855553:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122816 00000100:00100000:1.0:1789297437.855567:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122816 00000100:00100000:1.0:1789297437.855733:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:1.0:1789297437.855746:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13802:x1876213933122816:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:1.0:1789297437.856084:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41632450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13802:x1876213933122816:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 341us (735us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.856093:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 88 00000100:00100000:2.0:1789297437.865926:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297437.866023:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933122944 00000100:00100000:3.0:1789297437.866037:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933122944 00000100:00100000:3.0:1789297437.866105:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:3.0:1789297437.866116:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13802:x1876213933122944:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789297437.866440:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13802:x1876213933122944:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 326us (554us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.866450:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 89 00000100:00100000:2.0:1789297437.875403:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.875761:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123072 00000100:00100000:1.0:1789297437.875775:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123072 00000100:00100000:1.0:1789297437.875851:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:1.0:1789297437.875859:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:2352:x1876213933123072:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:1.0:1789297437.875888:0:14427:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 04eaf21b-7588-4cee-9d8c-40abfbdb26cc@192.168.202.43@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1789297437.875959:0:14427:0:(genops.c:1385:class_connect()) connect: client 04eaf21b-7588-4cee-9d8c-40abfbdb26cc, cookie 0x8ad177e823a0c7de 00000004:00100000:1.0:1789297437.875998:0:14427:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:1.0:1789297437.876005:0:14427:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00010000:00010000:0.0:1789297437.885992:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1789297437.967599:0:14427:0:(import.c:65:import_set_state_nolock()) ffff982a01cf1800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789297437.967695:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2352:x1876213933123072:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 91834us (92300us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.967736:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789297437.971155:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297437.971256:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297437.971975:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123200 00000100:00100000:3.0:1789297437.971986:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123200 00000100:00100000:3.0:1789297437.972114:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123328 00000100:00100000:3.0:1789297437.972118:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123328 00000100:00100000:3.0:1789297437.972155:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:3.0:1789297437.972166:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:0:x1876213933123200:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789297437.972230:0:14426:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260729856 avail 2258632704 00000100:00100000:3.0:1789297437.972347:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:0:x1876213933123200:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 183us (1205us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.972356:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:3.0:1789297437.972394:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789297437.972402:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13779:x1876213933123328:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:3.0:1789297437.972414:0:14426:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260729856 avail 2258632704 00000100:00100000:3.0:1789297437.972436:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13779:x1876213933123328:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 35us (1179us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.972442:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00080000:0.0:1789297437.973065:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297437.975837:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.976064:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123456 00000100:00100000:1.0:1789297437.976076:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123456 00000100:00100000:1.0:1789297437.976172:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:1.0:1789297437.976183:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13779:x1876213933123456:12345-192.168.202.43@tcp:40:mount.lustre.0 00000100:00100000:1.0:1789297437.976275:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13779:x1876213933123456:12345-192.168.202.43@tcp:40:mount.lustre.0 Request processed in 94us (450us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.976282:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789297437.979147:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297437.979329:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123584 00000100:00100000:1.0:1789297437.979340:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123584 00000100:00100000:1.0:1789297437.979395:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789297437.979405:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876213933123584:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789297437.979438:0:15107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 04eaf21b-7588-4cee-9d8c-40abfbdb26cc@192.168.202.43@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:1.0:1789297437.979471:0:15107:0:(genops.c:1385:class_connect()) connect: client 04eaf21b-7588-4cee-9d8c-40abfbdb26cc, cookie 0x8ad177e823a0c7e5 00002000:00100000:1.0:1789297437.979485:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 04eaf21b-7588-4cee-9d8c-40abfbdb26cc/ffff982a01cf5800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789297437.979506:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789297437.979927:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789297437.979969:0:15107:0:(import.c:65:import_set_state_nolock()) ffff982b278a5800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789297437.980044:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2352:x1876213933123584:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 639us (909us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297437.980053:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:2.0:1789297437.982587:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297437.982647:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297437.982753:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123840 00000100:00100000:0.0:1789297437.982763:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123840 00000100:00100000:0.0:1789297437.982813:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297437.982824:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3824aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13779:x1876213933123840:12345-192.168.202.43@tcp:33:mount.lustre.0 00000100:00100000:3.0:1789297437.982986:0:16122:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123712 00000100:00100000:3.0:1789297437.982991:0:16122:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123712 00000100:00100000:3.0:1789297437.983021:0:16122:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:3.0:1789297437.983026:0:16122:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2352:x1876213933123712:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:3.0:1789297437.983050:0:16122:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 04eaf21b-7588-4cee-9d8c-40abfbdb26cc@192.168.202.43@tcp t0 exp 0000000000000000 cur 449 last 0 00000020:00000080:3.0:1789297437.983083:0:16122:0:(genops.c:1385:class_connect()) connect: client 04eaf21b-7588-4cee-9d8c-40abfbdb26cc, cookie 0x8ad177e823a0c7ec 00002000:00100000:3.0:1789297437.983097:0:16122:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 04eaf21b-7588-4cee-9d8c-40abfbdb26cc/ffff982a031cf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1789297437.983124:0:16122:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1789297437.983465:0:16122:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1789297437.983494:0:16122:0:(import.c:65:import_set_state_nolock()) ffff982a031cc000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1789297437.983552:0:16122:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38249180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2352:x1876213933123712:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 525us (980us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297437.983574:0:16122:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000004:00080000:3.0:1789297437.985950:0:14428:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3042us 00000004:00200000:1.0:1789297438.000011:0:14428:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789297438.000161:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3824aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13779:x1876213933123840:12345-192.168.202.43@tcp:33:mount.lustre.0 Request processed in 17330us (17504us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297438.000177:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:2.0:1789297438.172036:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297438.172335:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933123968 00000100:00100000:1.0:1789297438.172347:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933123968 00000100:00100000:1.0:1789297438.172430:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789297438.172442:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13823:x1876213933123968:12345-192.168.202.43@tcp:101:mkdir.0 00010000:00010000:1.0:1789297438.172467:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297438.172867:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b000/0x8ad177e823a0c7f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd28 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297438.172943:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c7fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297438.172955:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297438.172968:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297438.173001:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789297438.173004:0:14425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297438.173041:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c7fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297438.173082:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b000/0x8ad177e823a0c7f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd28 expref: 8 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297438.173098:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c7fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd28 expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297438.173106:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:1.0:1789297438.173109:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789297438.173112:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b600, rc 0) 00000100:00100000:1.0:1789297438.173189:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38248000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:13823:x1876213933123968:12345-192.168.202.43@tcp:101:mkdir.0 Request processed in 749us (1168us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297438.173195:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00010000:00010000:0.0:1789297438.910420:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297439.677111:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957234304:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297439.677214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297439.677433:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234304 00000100:00100000:0.0:1789297439.677446:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234304 00000100:00100000:0.0:1789297439.677536:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1789297439.677547:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957234304:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297439.677587:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297439.677635:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38249880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3305:x1876213957234304:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297439.677643:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1789297439.677736:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1789297439.677765:0:3305:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1789297439.677791:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3305:1876213957234304:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1789297439.679360:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957234816:0@lo:400:kworker.0 00000100:00100000:3.0:1789297439.679430:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297439.679468:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1789297439.679476:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957234688:0@lo:400:kworker.0 00000100:00100000:3.0:1789297439.679499:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297439.679528:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234816 00000100:00100000:3.0:1789297439.679536:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234816 00000100:00100000:3.0:1789297439.679596:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234688 00000100:00100000:3.0:1789297439.679599:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234688 00000100:00100000:3.0:1789297439.679623:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789297439.679632:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957234816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297439.679683:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957234816:12345-0@lo:400:kworker.0 Request processed in 53us (252us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297439.679692:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1789297439.679728:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297439.679735:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957234688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297439.679764:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3305:x1876213957234688:12345-0@lo:400:kworker.0 Request processed in 29us (264us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297439.679769:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297439.679816:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3305:1876213957234688:0@lo:400:kworker.0 00000100:00100000:3.0:1789297439.679826:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957234816:0@lo:400:kworker.0 00000100:00080000:3.0:1789297439.679863:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297439.680231:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:930f46ad-32d3-437c-8414-ecdb73298d0c:3302:1876213957234432:0@lo:400:kworker.0 00000100:00100000:0.0:1789297439.680267:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297439.680312:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957234944:0@lo:400:kworker.0 00000100:00100000:0.0:1789297439.680340:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297439.680362:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1789297439.680368:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957234560:0@lo:400:kworker.0 00000100:00100000:0.0:1789297439.680390:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297439.680413:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234944 00000100:00100000:0.0:1789297439.680417:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234944 00000100:00100000:0.0:1789297439.680450:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1789297439.680456:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957234944:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297439.680486:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957234944:12345-0@lo:400:kworker.0 Request processed in 31us (145us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297439.680491:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1789297439.680505:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297439.680521:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957234944:0@lo:400:kworker.0 00000100:00100000:1.0:1789297439.680654:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234560 00000100:00100000:1.0:1789297439.680658:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234560 00000100:00100000:1.0:1789297439.680725:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789297439.680734:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957234560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297439.680770:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cdc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957234560:12345-0@lo:400:kworker.0 Request processed in 39us (380us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297439.680775:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1789297439.680793:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957234560:0@lo:400:kworker.0 00000100:00080000:0.0:1789297439.680847:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1789297439.684419:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957234432 00000100:00100000:3.0:1789297439.684438:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957234432 00000100:00100000:3.0:1789297439.684573:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1789297439.684586:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3302:x1876213957234432:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297439.684743:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3302:x1876213957234432:12345-0@lo:400:kworker.0 Request processed in 160us (4474us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297439.684751:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:1.0:1789297439.684856:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b067b1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:930f46ad-32d3-437c-8414-ecdb73298d0c:3302:1876213957234432:0@lo:400:kworker.0 00010000:00010000:1.0:1789297439.934142:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297440.064552:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.065735:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124096 00000100:00100000:0.0:1789297440.065748:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124096 00000100:00100000:0.0:1789297440.065898:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:0.0:1789297440.065909:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:13876:x1876213933124096:12345-192.168.202.43@tcp:41:lfs.0 00000004:00000024:0.0:1789297440.065967:0:14427:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2260729856 avail 2258632704 00000100:00100000:0.0:1789297440.066074:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:13876:x1876213933124096:12345-192.168.202.43@tcp:41:lfs.0 Request processed in 165us (1531us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.066082:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00080000:3.0:1789297440.066442:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297440.071664:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.071741:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124224 00000100:00100000:0.0:1789297440.071751:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124224 00000100:00100000:0.0:1789297440.071854:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:0.0:1789297440.071864:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13876:x1876213933124224:12345-192.168.202.43@tcp:13:lfs.0 00002000:00000024:0.0:1789297440.071958:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1789297440.072019:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1789297440.072052:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13876:x1876213933124224:12345-192.168.202.43@tcp:13:lfs.0 Request processed in 189us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.072058:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:2.0:1789297440.078063:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.079684:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124352 00000100:00100000:3.0:1789297440.079700:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124352 00000100:00080000:0.0:1789297440.079909:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789297440.079943:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789297440.079954:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13876:x1876213933124352:12345-192.168.202.43@tcp:13:lfs.0 00002000:00000024:3.0:1789297440.079982:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297440.080065:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38248e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:13876:x1876213933124352:12345-192.168.202.43@tcp:13:lfs.0 Request processed in 113us (2012us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.080072:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000001:00100000:3.0:1789297440.240617:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 04eaf21b-7588-4cee-9d8c-40abfbdb26cc 00000100:00100000:3.0:1789297440.325081:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.325155:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124480 00000100:00100000:0.0:1789297440.325168:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124480 00000100:00100000:0.0:1789297440.325235:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:0.0:1789297440.325242:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+10:13908:x1876213933124480:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:0.0:1789297440.325259:0:14419:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297440.325274:0:14419:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00030a00/0x8ad177e823a0c801 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd2f expref: -99 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.325302:0:14419:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00030a00/0x8ad177e823a0c801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd2f expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.325311:0:14419:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00030a00/0x8ad177e823a0c801 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd2f expref: 11 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.325318:0:14419:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00030a00, rc 0) 00000100:00100000:0.0:1789297440.325386:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13908:x1876213933124480:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 144us (316us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.325391:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 91 00000100:00100000:0.0:1789297440.333166:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.333257:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124608 00000100:00100000:3.0:1789297440.333267:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124608 00000100:00100000:3.0:1789297440.333323:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:3.0:1789297440.333334:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13908:x1876213933124608:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789297440.333644:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c12450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13908:x1876213933124608:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 312us (498us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.333684:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 92 00000100:00100000:2.0:1789297440.335797:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.335851:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124736 00000100:00100000:0.0:1789297440.335862:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124736 00000100:00100000:0.0:1789297440.335927:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 93 00000100:00100000:0.0:1789297440.335939:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13908:x1876213933124736:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:0.0:1789297440.336178:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c12c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13908:x1876213933124736:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 241us (388us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.336186:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 93 00000100:00100000:0.0:1789297440.342295:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.342381:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124864 00000100:00100000:3.0:1789297440.342395:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124864 00000100:00100000:3.0:1789297440.342464:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:3.0:1789297440.342490:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13913:x1876213933124864:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:3.0:1789297440.343048:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c12850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13913:x1876213933124864:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 566us (762us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.343057:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 94 00000100:00100000:3.0:1789297440.393568:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.393688:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933124992 00000100:00100000:0.0:1789297440.393739:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933124992 00000100:00100000:0.0:1789297440.393800:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:0.0:1789297440.393810:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13913:x1876213933124992:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297440.394108:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13913:x1876213933124992:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 299us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.394123:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 95 00000100:00100000:2.0:1789297440.405782:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.405926:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933125120 00000100:00100000:3.0:1789297440.405937:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933125120 00000100:00100000:3.0:1789297440.406001:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 96 00000100:00100000:3.0:1789297440.406012:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13908:x1876213933125120:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789297440.406031:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297440.406051:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0148fa00/0x8ad177e823a0c808 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd59 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297440.406080:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0148fa00/0x8ad177e823a0c808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd59 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297440.406092:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0148fa00/0x8ad177e823a0c808 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd59 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297440.406102:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148fa00, rc 0) 00000100:00100000:3.0:1789297440.406466:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13908:x1876213933125120:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 456us (693us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.406496:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 96 00000100:00100000:3.0:1789297440.424052:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.424146:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933125248 00000100:00100000:0.0:1789297440.424158:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933125248 00000100:00100000:0.0:1789297440.424212:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:0.0:1789297440.424220:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13908:x1876213933125248:12345-192.168.202.43@tcp:256:mount.lustre.0 20000000:01000000:0.0:1789297440.424246:0:14419:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1789297440.424273:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1789297440.424276:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1789297440.424278:0:14419:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1789297440.424279:0:14419:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1789297440.425475:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13908:x1876213933125248:12345-192.168.202.43@tcp:256:mount.lustre.0 Request processed in 1243us (1422us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.425491:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 97 00000100:00100000:2.0:1789297440.429132:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.429271:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933125376 00000100:00100000:3.0:1789297440.429280:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933125376 00000100:00100000:3.0:1789297440.429406:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:3.0:1789297440.429415:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13908:x1876213933125376:12345-192.168.202.43@tcp:101:mount.lustre.0 00010000:00010000:3.0:1789297440.429430:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297440.429444:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd60 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297440.429483:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297440.429492:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 13 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297440.429500:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0148e200, rc 0) 00000100:00100000:3.0:1789297440.429551:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13908:x1876213933125376:12345-192.168.202.43@tcp:101:mount.lustre.0 Request processed in 138us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.429556:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 98 00000100:00100000:0.0:1789297440.431223:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.431339:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933125504 00000100:00100000:3.0:1789297440.431348:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933125504 00000100:00100000:3.0:1789297440.431398:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:3.0:1789297440.431408:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13908:x1876213933125504:12345-192.168.202.43@tcp:501:mount.lustre.0 00000100:00100000:3.0:1789297440.431883:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13908:x1876213933125504:12345-192.168.202.43@tcp:501:mount.lustre.0 Request processed in 474us (665us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.431892:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 99 00000100:00100000:1.0:1789297440.434075:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.434142:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933125632 00000100:00100000:3.0:1789297440.434149:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933125632 00000100:00100000:3.0:1789297440.434198:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:3.0:1789297440.434206:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13908:x1876213933125632:12345-192.168.202.43@tcp:503:mount.lustre.0 00000100:00100000:3.0:1789297440.434405:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c10c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13908:x1876213933125632:12345-192.168.202.43@tcp:503:mount.lustre.0 Request processed in 199us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297440.434413:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 100 00000100:00100000:2.0:1789297440.438098:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.438384:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933125760 00000100:00100000:0.0:1789297440.438396:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933125760 00000100:00100000:0.0:1789297440.438506:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 101 00000100:00100000:0.0:1789297440.438517:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13919:x1876213933125760:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297440.439114:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13919:x1876213933125760:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 596us (1026us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.439131:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 101 00000100:00100000:1.0:1789297440.447128:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.447956:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933125888 00000100:00100000:0.0:1789297440.447969:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933125888 00000100:00100000:0.0:1789297440.448081:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 102 00000100:00100000:0.0:1789297440.448094:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13919:x1876213933125888:12345-192.168.202.43@tcp:502:llog_process_th.0 00000100:00100000:0.0:1789297440.448389:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c11c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13919:x1876213933125888:12345-192.168.202.43@tcp:502:llog_process_th.0 Request processed in 297us (1270us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.448398:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 102 00000100:00100000:1.0:1789297440.458085:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297440.458247:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297440.458305:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297440.458330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297440.458364:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126656 00000100:00100000:1.0:1789297440.458372:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126656 00000100:00100000:1.0:1789297440.458408:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126528 00000100:00100000:1.0:1789297440.458409:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126528 00000100:00100000:1.0:1789297440.458421:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789297440.458429:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2354:x1876213933126656:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297440.458499:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2354:x1876213933126656:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 69us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297440.458506:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789297440.458522:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:1.0:1789297440.458529:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2354:x1876213933126528:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297440.458551:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299c700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2354:x1876213933126528:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 24us (220us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297440.458556:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789297440.459725:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126016 00000100:00100000:3.0:1789297440.459845:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126400 00000100:00100000:3.0:1789297440.459851:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126400 00000100:00100000:2.0:1789297440.459903:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126016 00000100:00100000:2.0:1789297440.459948:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297440.459955:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2352:x1876213933126016:12345-192.168.202.43@tcp:38:mount.lustre.0 00010000:00080000:2.0:1789297440.459980:0:14426:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 68d12f81-8505-4ba9-b09f-f083255d6291@192.168.202.43@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1789297440.460017:0:14426:0:(genops.c:1385:class_connect()) connect: client 68d12f81-8505-4ba9-b09f-f083255d6291, cookie 0x8ad177e823a0c816 00000004:00100000:2.0:1789297440.460060:0:14426:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00100000:1.0:1789297440.460068:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:1.0:1789297440.460075:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:2354:x1876213933126400:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297440.460142:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:2354:x1876213933126400:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 68us (1894us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297440.460148:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00080000:2.0:1789297440.460980:0:14426:0:(import.c:65:import_set_state_nolock()) ffff982a01753800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297440.461232:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68d12f81-8505-4ba9-b09f-f083255d6291+6:2352:x1876213933126016:12345-192.168.202.43@tcp:38:mount.lustre.0 Request processed in 1274us (3156us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297440.461241:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789297440.472966:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297440.473010:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297440.473213:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126272 00000100:00100000:2.0:1789297440.473224:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126272 00000100:00100000:2.0:1789297440.473292:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126144 00000100:00100000:2.0:1789297440.473295:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126144 00000100:00100000:2.0:1789297440.473318:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789297440.473326:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+7:13908:x1876213933126272:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789297440.473369:0:15131:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2260729856 avail 2258632704 00000100:00100000:2.0:1789297440.473433:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+7:13908:x1876213933126272:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 108us (496us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297440.473439:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789297440.473455:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:2.0:1789297440.473461:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+6:0:x1876213933126144:12345-192.168.202.43@tcp:41:mount.lustre.0 00000004:00000024:2.0:1789297440.473470:0:15131:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2260729856 avail 2258632704 00000100:00100000:2.0:1789297440.473489:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+6:0:x1876213933126144:12345-192.168.202.43@tcp:41:mount.lustre.0 Request processed in 29us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297440.473495:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00080000:3.0:1789297440.473839:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297440.477882:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297440.478009:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126784 00000100:00100000:2.0:1789297440.478020:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126784 00000100:00100000:2.0:1789297440.478082:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789297440.478091:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+6:13908:x1876213933126784:12345-192.168.202.43@tcp:40:mount.lustre.0 00000100:00100000:2.0:1789297440.478174:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+6:13908:x1876213933126784:12345-192.168.202.43@tcp:40:mount.lustre.0 Request processed in 83us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297440.478194:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:3.0:1789297440.482251:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.482289:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297440.482328:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297440.482423:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933126912 00000100:00100000:1.0:1789297440.482446:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933126912 00000100:00100000:1.0:1789297440.482482:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127040 00000100:00100000:1.0:1789297440.482496:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127040 00000100:00100000:1.0:1789297440.482517:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789297440.482525:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2352:x1876213933126912:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:1.0:1789297440.482554:0:15110:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 68d12f81-8505-4ba9-b09f-f083255d6291@192.168.202.43@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:1.0:1789297440.482586:0:15110:0:(genops.c:1385:class_connect()) connect: client 68d12f81-8505-4ba9-b09f-f083255d6291, cookie 0x8ad177e823a0c81d 00002000:00100000:1.0:1789297440.482610:0:15110:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 68d12f81-8505-4ba9-b09f-f083255d6291/ffff982b278a2000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1789297440.482622:0:15110:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1789297440.482760:0:15110:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1789297440.482789:0:15110:0:(import.c:65:import_set_state_nolock()) ffff982b278a5000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1789297440.482983:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789297440.482990:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2352:x1876213933127040:12345-192.168.202.43@tcp:8:mount.lustre.0 00010000:00080000:2.0:1789297440.483005:0:15107:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 68d12f81-8505-4ba9-b09f-f083255d6291@192.168.202.43@tcp t0 exp 0000000000000000 cur 452 last 0 00000020:00000080:2.0:1789297440.483025:0:15107:0:(genops.c:1385:class_connect()) connect: client 68d12f81-8505-4ba9-b09f-f083255d6291, cookie 0x8ad177e823a0c824 00002000:00100000:2.0:1789297440.483031:0:15107:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 68d12f81-8505-4ba9-b09f-f083255d6291/ffff982a01755800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211396c ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1789297440.483038:0:15107:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1789297440.483217:0:15107:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1789297440.483231:0:15107:0:(import.c:65:import_set_state_nolock()) ffff982a01750800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1789297440.483276:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+6:2352:x1876213933126912:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 751us (1039us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297440.483283:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:0.0:1789297440.485899:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127168 00000100:00100000:0.0:1789297440.485915:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127168 00000100:00100000:0.0:1789297440.485985:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:0.0:1789297440.485996:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68d12f81-8505-4ba9-b09f-f083255d6291+6:13908:x1876213933127168:12345-192.168.202.43@tcp:33:mount.lustre.0 00000004:00200000:0.0:1789297440.486071:0:14429:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000100:00100000:2.0:1789297440.486795:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68d12f81-8505-4ba9-b09f-f083255d6291+6:2352:x1876213933127040:12345-192.168.202.43@tcp:8:mount.lustre.0 Request processed in 3799us (4500us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297440.486807:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:0.0:1789297440.501801:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68d12f81-8505-4ba9-b09f-f083255d6291+6:13908:x1876213933127168:12345-192.168.202.43@tcp:33:mount.lustre.0 Request processed in 15793us (19458us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.501818:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:1.0:1789297440.658980:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297440.659071:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127296 00000100:00100000:0.0:1789297440.659081:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127296 00000100:00100000:0.0:1789297440.659129:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:0.0:1789297440.659137:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68d12f81-8505-4ba9-b09f-f083255d6291+6:13940:x1876213933127296:12345-192.168.202.43@tcp:101:mkdir.0 00010000:00010000:0.0:1789297440.659155:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297440.659178:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c82b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd8a expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.659243:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.659265:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.659276:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297440.659305:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789297440.659308:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297440.659323:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.659343:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c82b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 8 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.659357:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297440.659363:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:0.0:1789297440.659365:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1789297440.659367:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031600, rc 0) 00000100:00100000:0.0:1789297440.659419:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68d12f81-8505-4ba9-b09f-f083255d6291+7:13940:x1876213933127296:12345-192.168.202.43@tcp:101:mkdir.0 Request processed in 283us (450us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297440.659423:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00010000:00010000:0.0:1789297440.956956:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1789297441.257893:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 68d12f81-8505-4ba9-b09f-f083255d6291 00000001:00100000:0.0:1789297441.257907:0:6712:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 04eaf21b-7588-4cee-9d8c-40abfbdb26cc 00010000:00010000:3.0:1789297441.983192:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297442.237835:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957235072:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297442.237921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297442.238093:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235072 00000100:00100000:0.0:1789297442.238103:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235072 00000100:00100000:0.0:1789297442.238178:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1789297442.238188:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957235072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297442.238223:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297442.238264:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957235072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (343us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297442.238270:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1789297442.238754:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957235072:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1789297442.245104:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1789297443.008327:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1789297443.225967:0:16391:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000040:00080000:2.0:1789297443.326514:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000001:00100000:3.0:1789297443.326749:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 04eaf21b-7588-4cee-9d8c-40abfbdb26cc 00000001:00100000:3.0:1789297443.326884:0:5864:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 68d12f81-8505-4ba9-b09f-f083255d6291 00010000:00010000:0.0:1789297444.029028:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297444.799228:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957235200:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1789297444.799295:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297444.799344:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957235712:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799366:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297444.799391:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:1.0:1789297444.799396:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957235328:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297444.799451:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957235840:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799472:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297444.799500:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957235456:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799528:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297444.799545:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957235968:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799593:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297444.799616:0:3302:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1789297444.799623:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982a0299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957235584:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799645:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297444.799678:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235712 00000100:00100000:1.0:1789297444.799685:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235712 00000100:00100000:1.0:1789297444.799756:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235840 00000100:00100000:1.0:1789297444.799760:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235840 00000100:00100000:1.0:1789297444.799786:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235968 00000100:00100000:1.0:1789297444.799789:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235968 00000100:00100000:1.0:1789297444.799809:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789297444.799818:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957235712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799885:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3304:x1876213957235712:12345-0@lo:400:kworker.0 Request processed in 68us (517us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297444.799893:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1789297444.799912:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789297444.799919:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957235840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.799949:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3304:x1876213957235840:12345-0@lo:400:kworker.0 Request processed in 30us (476us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297444.799955:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1789297444.799976:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789297444.799982:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957235968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800016:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38227b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3302:x1876213957235968:12345-0@lo:400:kworker.0 Request processed in 34us (444us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297444.800022:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:1.0:1789297444.800041:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235328 00000100:00100000:1.0:1789297444.800045:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235328 00000100:00100000:1.0:1789297444.800067:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789297444.800073:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38c13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3304:x1876213957235328:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800102:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38c13850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3304:x1876213957235328:12345-0@lo:400:kworker.0 Request processed in 29us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297444.800108:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1789297444.800136:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235456 00000100:00100000:1.0:1789297444.800139:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235456 00000100:00100000:1.0:1789297444.800161:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235584 00000100:00100000:1.0:1789297444.800163:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235584 00000100:00100000:1.0:1789297444.800183:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789297444.800190:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957235456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800219:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957235456:12345-0@lo:400:kworker.0 Request processed in 30us (690us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297444.800225:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1789297444.800235:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297444.800240:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957235584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800265:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957235584:12345-0@lo:400:kworker.0 Request processed in 25us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297444.800270:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1789297444.800315:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957235584:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800331:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957235456:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800339:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b38226a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3302:1876213957235968:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800367:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957235328:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800375:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3304:1876213957235840:0@lo:400:kworker.0 00000100:00100000:1.0:1789297444.800381:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299e680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3304:1876213957235712:0@lo:400:kworker.0 00000100:00100000:0.0:1789297444.808656:0:15111:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957235200 00000100:00100000:0.0:1789297444.808671:0:15111:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957235200 00000100:00080000:2.0:1789297444.808825:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297444.808844:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1789297444.808848:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297444.808965:0:15111:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789297444.808978:0:15111:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957235200:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1789297444.809021:0:15111:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297444.809117:0:15111:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38225180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957235200:12345-0@lo:13:osp-pre-1-0.0 Request processed in 142us (9822us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297444.809126:0:15111:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1789297444.809235:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982a0299dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957235200:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1789297445.053019:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1789297445.398031:0:7644:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 68d12f81-8505-4ba9-b09f-f083255d6291 00000100:00100000:1.0:1789297445.875519:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297445.875568:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297445.875597:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297445.875617:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297445.875632:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297445.875647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297445.875664:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127424 00000100:00100000:1.0:1789297445.875672:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297445.875676:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127424 00000100:00100000:1.0:1789297445.875695:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127680 00000100:00100000:1.0:1789297445.875699:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127680 00000100:00100000:3.0:1789297445.875755:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:3.0:1789297445.875767:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4051f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2356:x1876213933127424:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297445.875768:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128192 00000100:00100000:1.0:1789297445.875773:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128192 00000100:00100000:1.0:1789297445.875792:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127808 00000100:00100000:1.0:1789297445.875796:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127808 00000100:00100000:1.0:1789297445.875811:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128064 00000100:00100000:1.0:1789297445.875814:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128064 00000100:00100000:1.0:1789297445.875848:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:3.0:1789297445.875854:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4051f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2356:x1876213933127424:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 88us (343us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297445.875860:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2356:x1876213933127680:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297445.875877:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 104 00000100:00100000:1.0:1789297445.875911:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2356:x1876213933127680:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 52us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297445.875932:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:1.0:1789297445.875949:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789297445.875957:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2356:x1876213933128192:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297445.875985:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2356:x1876213933128192:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 30us (368us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297445.875991:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789297445.876006:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789297445.876026:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2356:x1876213933127808:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297445.876062:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2356:x1876213933127808:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 50us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297445.876075:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789297445.876085:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789297445.876092:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2356:x1876213933128064:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297445.876111:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2356:x1876213933128064:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 20us (439us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297445.876117:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789297445.876132:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127936 00000100:00100000:1.0:1789297445.876135:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127936 00000100:00100000:1.0:1789297445.876156:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933127552 00000100:00100000:1.0:1789297445.876165:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933127552 00000100:00100000:1.0:1789297445.876187:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:1.0:1789297445.876194:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+6:2356:x1876213933127936:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297445.876226:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+6:2356:x1876213933127936:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32us (628us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297445.876239:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:1.0:1789297445.876252:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:1.0:1789297445.876259:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2356:x1876213933127552:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297445.876280:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2356:x1876213933127552:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 22us (647us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297445.876285:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00080000:1.0:1789297445.876314:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1789297445.876318:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789297445.876320:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1789297446.079145:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1789297446.745520:0:16543:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffefe37bbe0 20000000:00000080:3.0:1789297446.745540:0:16543:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff982a024ef000 uarg=0000000000000000 20000000:01000000:3.0:1789297446.745580:0:16543:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789297446.745586:0:16543:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:3.0:1789297446.745591:0:16543:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:0.0:1789297446.747232:0:16544:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1789297446.747497:0:16543:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1789297446.760967:0:16543:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:0.0:1789297446.761149:0:16543:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761172:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761181:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761188:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 18 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761213:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761220:0:16543:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761227:0:16543:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761272:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761289:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 12 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.761305:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236096:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297446.761531:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761540:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 12 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.761548:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236224:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297446.761578:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 18 pid: 14419 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761586:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 18 pid: 14419 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.761606:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236352:0@lo:104: 00000100:00100000:0.0:1789297446.761648:0:16543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297446.761784:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.761793:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 18 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.761801:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236480:0@lo:104: 00000100:00100000:0.0:1789297446.761836:0:16543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:0.0:1789297446.764263:0:16543:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 18 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.764283:0:16543:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 18 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.764298:0:16543:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236608:0@lo:104: 00000100:00100000:0.0:1789297446.764352:0:16543:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297446.765008:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957236352 00000100:00100000:2.0:1789297446.765018:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957236352 00000100:00100000:2.0:1789297446.765074:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957236480 00000100:00100000:2.0:1789297446.765079:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957236480 00000100:00100000:2.0:1789297446.765096:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297446.765105:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+4:16543:x1876213957236352:12345-0@lo:104: 00010000:00010000:2.0:1789297446.765120:0:14409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765186:0:14409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789297446.765205:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+4:16543:x1876213957236352:12345-0@lo:104: Request processed in 101us (3556us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297446.765213:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297446.765233:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297446.765239:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+3:16543:x1876213957236480:12345-0@lo:104: 00010000:00010000:2.0:1789297446.765248:0:14409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765284:0:14409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1789297446.765289:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cfb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+3:16543:x1876213957236480:12345-0@lo:104: Request processed in 51us (3452us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297446.765295:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1789297446.765312:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1789297446.765318:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765327:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0148f000 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297446.765332:0:15698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765342:0:15698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297446.765350:0:15698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297446.765357:0:15698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789297446.765578:0:15698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765595:0:15698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297446.765621:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765628:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b0148f000/0x8ad177e823a0c6b1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c6b8 expref: -99 pid: 15826 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765643:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1789297446.765646:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765651:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b059bac00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:2.0:1789297446.765653:0:15698:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765661:0:15698:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1789297446.765667:0:15698:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1789297446.765672:0:15698:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:2.0:1789297446.765782:0:15698:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765788:0:15698:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1789297446.765805:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765826:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b059bac00/0x8ad177e823a0c576 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c57d expref: -99 pid: 15106 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.765843:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297446.765845:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1789297446.765847:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297446.765877:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b3824b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957236736:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297446.765916:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297446.765960:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957236864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1789297446.765983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297446.766015:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957236736 00000100:00100000:2.0:1789297446.766020:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957236736 00010000:00010000:2.0:1789297446.766040:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 19 pid: 14419 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297446.766125:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957236864 00000100:00100000:2.0:1789297446.766130:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957236864 00010000:00010000:2.0:1789297446.766143:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 20 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297446.766157:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297446.766164:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+20:3303:x1876213957236736:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297446.766175:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297446.766180:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 20 pid: 14419 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.766190:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 20 pid: 14419 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.766212:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297446.766242:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+20:3303:x1876213957236736:12345-0@lo:103:ldlm_bl.0 Request processed in 79us (324us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297446.766255:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1789297446.766271:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297446.766276:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3304:x1876213957236864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297446.766283:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297446.766288:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 19 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.766296:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 19 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.766306:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297446.766329:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3304:x1876213957236864:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297446.766335:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1789297446.766371:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b3824b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957236736:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1789297446.766553:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297446.766595:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:930f46ad-32d3-437c-8414-ecdb73298d0c:3304:1876213957236864:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297446.766971:0:16543:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969180 going to sleep for 11 seconds 00010000:00010000:0.0:1789297446.766988:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b382b3200/0x8ad177e823a0c6b8 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0c6b1 expref: 18 pid: 14419 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.767000:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ced80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236352:0@lo:104: 00010000:00010000:0.0:1789297446.767009:0:16543:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0148ea00/0x8ad177e823a0c57d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0c576 expref: 17 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.767016:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cd180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236480:0@lo:104: 00000100:00100000:3.0:1789297446.769213:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957236608 00000100:00100000:3.0:1789297446.769228:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957236608 00000100:00100000:2.0:1789297446.770045:0:14409:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1789297446.770089:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789297446.770101:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3869c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+3:16543:x1876213957236608:12345-0@lo:104: 00010000:00010000:2.0:1789297446.770119:0:14409:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.770938:0:14409:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1789297446.770951:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3869c050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:930f46ad-32d3-437c-8414-ecdb73298d0c+3:16543:x1876213957236608:12345-0@lo:104: Request processed in 850us (6595us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297446.770960:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1789297446.771374:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cc000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236608:0@lo:104: 00010000:00010000:1.0:1789297446.771554:0:14414:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1789297446.771566:0:14414:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.771575:0:14414:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2c00 already unused, calling callback (ffffffffc1c8ac20) 10000000:00010000:1.0:1789297446.771580:0:14414:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.771590:0:14414:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1789297446.771598:0:14414:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297446.771605:0:14414:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1789297446.771662:0:14414:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.771678:0:14414:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:0.0:1789297446.771867:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:930f46ad-32d3-437c-8414-ecdb73298d0c:3305:1876213957236992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297446.771928:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1789297446.771985:0:14414:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.771993:0:14414:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.202.143@tcp lock: ffff982b382b2c00/0x8ad177e823a0c529 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x8ad177e823a0c530 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.772010:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297446.772012:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297446.772014:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297446.772093:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957236992 00000100:00100000:2.0:1789297446.772101:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957236992 00010000:00010000:2.0:1789297446.772129:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 17 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297446.772303:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1789297446.772313:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+17:3305:x1876213957236992:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1789297446.772329:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297446.772336:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 17 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.772359:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 17 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.772375:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b38257e00/0x8ad177e823a0c530 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x8ad177e823a0c529 expref: 17 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.772388:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297446.772913:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297446.773071:0:14410:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789297446.773122:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ae6050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:3305:x1876213957236992:12345-0@lo:103:ldlm_bl.0 Request processed in 810us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297446.773129:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1789297446.773286:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297446.773780:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:1.0:1789297446.773943:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128320 00000100:00100000:1.0:1789297446.773950:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128320 00010000:00010000:1.0:1789297446.773980:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 13 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297446.774009:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:1.0:1789297446.774017:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2353:x1876213933128320:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297446.774029:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297446.774034:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 13 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.774046:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 13 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297446.774227:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:930f46ad-32d3-437c-8414-ecdb73298d0c:3305:1876213957236992:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1789297446.774276:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276ce680 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236096:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297446.774286:0:16543:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16543:1876213957236224:192.168.202.43@tcp:104: 00010000:00010000:1.0:1789297446.774331:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0148e200/0x8ad177e823a0c80f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd60 expref: 13 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297446.774865:0:14412:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789297446.774876:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128448 00000100:00100000:2.0:1789297446.774881:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128448 00010000:00010000:2.0:1789297446.774900:0:14412:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 13 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297446.774918:0:14412:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00000100:00100000:2.0:1789297446.774926:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:2.0:1789297446.774932:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2353:x1876213933128448:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297446.774951:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297446.774957:0:14412:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 13 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297446.775055:0:16543:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.775498:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297446.775559:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2353:x1876213933128320:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 1542us (2649us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297446.775568:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00010000:00010000:2.0:1789297446.775940:0:14412:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 12 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.775958:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c7d7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dcfe expref: 12 pid: 14420 timeout: 558 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.775971:0:14412:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.775979:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.775995:0:14412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.776003:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.776021:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.776029:0:14412:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.776035:0:14412:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297446.776039:0:14412:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.776136:0:14412:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.776975:0:16543:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297446.776986:0:16543:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 5/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.778938:0:14412:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 3/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.778959:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff982b00031a00/0x8ad177e823a0c839 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16543 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297446.778984:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297446.779170:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:2353:x1876213933128448:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 4229us (5875us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297446.779182:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00010000:00010000:2.0:1789297447.102930:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297447.359221:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297447.359250:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957237120:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1789297447.359334:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297447.359851:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957237120 00000100:00100000:0.0:1789297447.359863:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957237120 00000100:00100000:0.0:1789297447.359932:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1789297447.359944:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957237120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1789297447.359980:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1789297447.360048:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957237120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 106us (713us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297447.360055:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00080000:1.0:1789297447.360635:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297447.360684:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b276cdf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957237120:0@lo:13:osp-pre-0-0.0 10000000:01000000:2.0:1789297447.998814:0:14422:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:2.0:1789297447.998822:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b06788000 from 10 10000000:01000000:2.0:1789297447.998829:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1789297447.998881:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38257a00/0x8ad177e823a0c840 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297447.998892:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b38257a00/0x8ad177e823a0c840 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297447.998905:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b38257a00/0x8ad177e823a0c840 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297447.998934:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237248:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1789297447.999015:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297447.999080:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b183950c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297447.999239:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957237248 00000100:00100000:1.0:1789297447.999249:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957237248 00000100:00100000:1.0:1789297447.999303:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789297447.999312:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b4051d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+16:14422:x1876213957237248:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297447.999327:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297447.999353:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c847 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c840 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297447.999378:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c840 expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297447.999389:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152b400/0x8ad177e823a0c847 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c840 expref: 17 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297447.999407:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b400, rc 0) 00000100:00100000:1.0:1789297447.999455:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b4051d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:930f46ad-32d3-437c-8414-ecdb73298d0c+17:14422:x1876213957237248:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (440us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297447.999462:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:1.0:1789297447.999516:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237248:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297447.999530:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b38257a00/0x8ad177e823a0c840 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c847 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297447.999540:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b38257a00/0x8ad177e823a0c840 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c847 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297447.999598:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297447.999624:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297447.999638:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297447.999651:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957237376 00000100:00100000:1.0:1789297447.999655:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957237376 00000100:00100000:1.0:1789297447.999681:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789297447.999687:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:14422:x1876213957237376:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297447.999985:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:14422:x1876213957237376:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 297us (360us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297447.999993:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:1.0:1789297448.000025:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237376:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.000059:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237504:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.000097:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297448.000129:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304840 going to sleep for 11 seconds 00000100:00100000:1.0:1789297448.000142:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957237504 00000100:00100000:1.0:1789297448.000146:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957237504 00000100:00100000:1.0:1789297448.000168:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789297448.000174:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:14422:x1876213957237504:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.000313:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:14422:x1876213957237504:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 138us (214us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297448.000321:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:1.0:1789297448.000355:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237504:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789297448.001032:0:16594:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789297448.001096:0:14422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789297448.001116:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789297448.001125:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b38257a00/0x8ad177e823a0c840 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c847 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.001134:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b38257a00/0x8ad177e823a0c840 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c847 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297448.001143:0:14422:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789297448.001145:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b276e1800 from 10 10000000:01000000:1.0:1789297448.001147:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789297448.001171:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152be00/0x8ad177e823a0c84e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.001179:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152be00/0x8ad177e823a0c84e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.001187:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152be00/0x8ad177e823a0c84e lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297448.001213:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237632:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.001247:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297448.001265:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297448.001278:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957237632 00000100:00100000:1.0:1789297448.001282:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957237632 00000100:00100000:1.0:1789297448.001305:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789297448.001312:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+17:14422:x1876213957237632:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297448.001320:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297448.001330:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152b000/0x8ad177e823a0c855 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c84e expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.001347:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152b000/0x8ad177e823a0c855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c84e expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.001357:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152b000/0x8ad177e823a0c855 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c84e expref: 18 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.001364:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b000, rc 0) 00000100:00100000:1.0:1789297448.001393:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:14422:x1876213957237632:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 81us (145us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297448.001399:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:1.0:1789297448.001433:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237632:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297448.001444:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152be00/0x8ad177e823a0c84e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c855 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.001453:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152be00/0x8ad177e823a0c84e lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c855 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297448.001497:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.001520:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297448.001532:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297448.001543:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957237760 00000100:00100000:1.0:1789297448.001546:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957237760 00000100:00100000:1.0:1789297448.001567:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789297448.001573:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:14422:x1876213957237760:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.001778:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02ede050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:14422:x1876213957237760:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 204us (256us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297448.001784:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:1.0:1789297448.001823:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237760:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.001841:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237888:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.001866:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297448.001875:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297448.001882:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957237888 00000100:00100000:1.0:1789297448.001884:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957237888 00000100:00100000:1.0:1789297448.001897:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789297448.001900:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:14422:x1876213957237888:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.001985:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:14422:x1876213957237888:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 84us (118us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297448.001990:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:1.0:1789297448.002023:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957237888:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1789297448.002570:0:16595:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1789297448.002607:0:14422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1789297448.002621:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1789297448.002627:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152be00/0x8ad177e823a0c84e lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c855 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.002635:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152be00/0x8ad177e823a0c84e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c855 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1789297448.002644:0:14422:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1789297448.002645:0:14422:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff982b055c7000 from 10 10000000:01000000:1.0:1789297448.002648:0:14422:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1789297448.002664:0:14422:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152b200/0x8ad177e823a0c85c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.002669:0:14422:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.202.143@tcp lock: ffff982b0152b200/0x8ad177e823a0c85c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.002675:0:14422:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.202.143@tcp lock: ffff982b0152b200/0x8ad177e823a0c85c lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297448.002684:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957238016:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.002721:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297448.002732:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b053049c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297448.002742:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238016 00000100:00100000:1.0:1789297448.002744:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238016 00000100:00100000:1.0:1789297448.002759:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1789297448.002763:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+18:14422:x1876213957238016:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297448.002768:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297448.002774:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152a600/0x8ad177e823a0c863 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x8ad177e823a0c85c expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.002792:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152a600/0x8ad177e823a0c863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x8ad177e823a0c85c expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.009812:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152a600/0x8ad177e823a0c863 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x8ad177e823a0c85c expref: 19 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.009841:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a600, rc 0) 00000100:00100000:1.0:1789297448.009937:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957238016:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 7169us (7210us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297448.009946:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1789297448.010113:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957238016:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1789297448.010137:0:14422:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.202.143@tcp lock: ffff982b0152b200/0x8ad177e823a0c85c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c863 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297448.010148:0:14422:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.202.143@tcp lock: ffff982b0152b200/0x8ad177e823a0c85c lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x8ad177e823a0c863 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297448.010242:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957238144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297448.010276:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297448.010316:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11f4b9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1789297448.010421:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238144 00000100:00100000:0.0:1789297448.010429:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238144 00000100:00100000:0.0:1789297448.010473:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:0.0:1789297448.010483:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957238144:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297448.010740:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02ede850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957238144:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 258us (462us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297448.010748:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1789297448.011328:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957238144:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1789297448.011362:0:14422:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957238272:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297448.011412:0:14422:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297448.011447:0:14422:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b11f4b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297448.011449:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238272 00000100:00100000:1.0:1789297448.011453:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238272 00000100:00100000:1.0:1789297448.011516:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:1.0:1789297448.011525:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957238272:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1789297448.011680:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02ede450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:14422:x1876213957238272:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 156us (279us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297448.011687:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1789297448.011777:0:14422:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:930f46ad-32d3-437c-8414-ecdb73298d0c:14422:1876213957238272:0@lo:503:ll_cfg_requeue.0 00000040:00080000:3.0:1789297448.012425:0:16596:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1789297448.012480:0:14422:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1789297448.012497:0:14422:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.202.143@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1789297448.012506:0:14422:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.202.143@tcp lock: ffff982b0152b200/0x8ad177e823a0c85c lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c863 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297448.012516:0:14422:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.202.143@tcp lock: ffff982b0152b200/0x8ad177e823a0c85c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x8ad177e823a0c863 expref: -99 pid: 14422 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297448.047943:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297448.048168:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128576 00000100:00100000:1.0:1789297448.048180:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128576 00000100:00100000:1.0:1789297448.048272:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:1.0:1789297448.048284:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+11:13793:x1876213933128576:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1789297448.048302:0:14420:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297448.048321:0:14420:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b0152a200/0x8ad177e823a0c86a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd91 expref: -99 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.048361:0:14420:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b0152a200/0x8ad177e823a0c86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd91 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.048386:0:14420:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b0152a200/0x8ad177e823a0c86a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd91 expref: 12 pid: 14420 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297448.048396:0:14420:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a200, rc 0) 00000100:00100000:1.0:1789297448.048451:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13793:x1876213933128576:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 170us (522us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297448.048459:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 114 00000100:00100000:3.0:1789297448.052157:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297448.052435:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128704 00000100:00100000:0.0:1789297448.052446:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128704 00000100:00100000:0.0:1789297448.052500:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:0.0:1789297448.052523:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13793:x1876213933128704:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1789297448.052995:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13793:x1876213933128704:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 473us (847us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297448.053004:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 115 00000100:00100000:1.0:1789297448.078164:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297448.078233:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128832 00000100:00100000:3.0:1789297448.078244:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128832 00000100:00100000:3.0:1789297448.078302:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:3.0:1789297448.078313:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13793:x1876213933128832:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297448.078605:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13793:x1876213933128832:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 293us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297448.078614:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 116 00000100:00100000:3.0:1789297448.103430:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297448.103663:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933128960 00000100:00100000:0.0:1789297448.103675:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933128960 00000100:00100000:0.0:1789297448.103757:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:0.0:1789297448.103767:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+12:13793:x1876213933128960:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1789297448.103786:0:14417:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297448.103814:0:14417:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff982b00030200/0x8ad177e823a0c871 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd98 expref: -99 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297448.103843:0:14417:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff982b00030200/0x8ad177e823a0c871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd98 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297448.103854:0:14417:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff982b00030200/0x8ad177e823a0c871 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd98 expref: 13 pid: 14417 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297448.103863:0:14417:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00030200, rc 0) 00000100:00100000:0.0:1789297448.103922:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13793:x1876213933128960:12345-192.168.202.43@tcp:101:ll_cfg_requeue.0 Request processed in 157us (504us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297448.103929:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 117 00000100:00100000:0.0:1789297448.105933:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297448.106034:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933129088 00000100:00100000:2.0:1789297448.106044:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933129088 00000100:00100000:2.0:1789297448.106099:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:2.0:1789297448.106117:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13793:x1876213933129088:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1789297448.106436:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13793:x1876213933129088:12345-192.168.202.43@tcp:501:ll_cfg_requeue.0 Request processed in 319us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297448.106444:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 118 00000100:00100000:2.0:1789297448.108867:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297448.108945:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933129216 00000100:00100000:3.0:1789297448.108955:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933129216 00000100:00100000:3.0:1789297448.109010:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 119 00000100:00100000:3.0:1789297448.109022:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13793:x1876213933129216:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1789297448.109231:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:13793:x1876213933129216:12345-192.168.202.43@tcp:503:ll_cfg_requeue.0 Request processed in 211us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297448.109248:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 119 00010000:00010000:2.0:1789297448.124931:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1789297449.149297:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297449.917161:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957238400:0@lo:400:kworker.0 00000100:00100000:1.0:1789297449.917237:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297449.917289:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957238912:0@lo:400:kworker.0 00000100:00100000:1.0:1789297449.917314:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297449.917339:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1789297449.917344:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957238784:0@lo:400:kworker.0 00000100:00100000:1.0:1789297449.917376:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297449.917405:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238912 00000100:00100000:1.0:1789297449.917412:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238912 00000100:00100000:1.0:1789297449.917456:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238784 00000100:00100000:1.0:1789297449.917459:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238784 00000100:00100000:1.0:1789297449.917477:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789297449.917485:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957238912:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297449.917549:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3303:x1876213957238912:12345-0@lo:400:kworker.0 Request processed in 53us (222us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297449.917556:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1789297449.917585:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1789297449.917591:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957238784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1789297449.917618:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957238784:12345-0@lo:400:kworker.0 Request processed in 27us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297449.917623:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:1.0:1789297449.917640:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1789297449.917670:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957238784:0@lo:400:kworker.0 00000100:00100000:1.0:1789297449.917679:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3303:1876213957238912:0@lo:400:kworker.0 00000100:00100000:0.0:1789297449.918051:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957238528:0@lo:400:kworker.0 00000100:00100000:0.0:1789297449.918093:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297449.918121:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957239040:0@lo:400:kworker.0 00000100:00100000:0.0:1789297449.918149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297449.918166:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1789297449.918172:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957238656:0@lo:400:kworker.0 00000100:00100000:0.0:1789297449.918189:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297449.918231:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957239040 00000100:00100000:0.0:1789297449.918234:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957239040 00000100:00100000:0.0:1789297449.918260:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789297449.918266:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957239040:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297449.918298:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cc000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3304:x1876213957239040:12345-0@lo:400:kworker.0 Request processed in 32us (148us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297449.918305:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1789297449.918328:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3304:1876213957239040:0@lo:400:kworker.0 00000100:00100000:2.0:1789297449.918392:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238528 00000100:00100000:2.0:1789297449.918396:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238528 00000100:00100000:2.0:1789297449.918429:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238656 00000100:00100000:2.0:1789297449.918432:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238656 00000100:00100000:2.0:1789297449.918452:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789297449.918458:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957238528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297449.918495:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276ce680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957238528:12345-0@lo:400:kworker.0 Request processed in 38us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297449.918501:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1789297449.918512:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789297449.918518:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957238656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297449.918551:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957238656:12345-0@lo:400:kworker.0 Request processed in 33us (361us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297449.918557:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1789297449.918581:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957238656:0@lo:400:kworker.0 00000100:00100000:2.0:1789297449.918589:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957238528:0@lo:400:kworker.0 00000100:00100000:3.0:1789297449.918889:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957238400 00000100:00100000:3.0:1789297449.918894:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957238400 00000100:00100000:3.0:1789297449.918930:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1789297449.918937:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3303:x1876213957238400:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297449.918985:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02edd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3303:x1876213957238400:12345-0@lo:400:kworker.0 Request processed in 49us (1747us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297449.918991:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:0.0:1789297449.919059:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:930f46ad-32d3-437c-8414-ecdb73298d0c:3303:1876213957238400:0@lo:400:kworker.0 00000100:00080000:1.0:1789297449.919606:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1789297449.919610:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1789297449.919612:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297449.919726:0:3304:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1789297449.919748:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b27af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957239168:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297449.919792:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297449.919911:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957239168 00000100:00100000:3.0:1789297449.919916:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957239168 00000100:00100000:3.0:1789297449.919955:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1789297449.919963:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957239168:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297449.919991:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1789297449.920036:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957239168:12345-0@lo:13:osp-pre-1-0.0 Request processed in 74us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297449.920042:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:0.0:1789297449.920199:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b27af5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957239168:0@lo:13:osp-pre-1-0.0 00010000:00010000:2.0:1789297450.172869:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297450.475130:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.477905:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933129344 00000100:00100000:1.0:1789297450.478450:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933129344 00000100:00100000:1.0:1789297450.478608:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:1.0:1789297450.478623:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:14451:x1876213933129344:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297450.478646:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297450.478669:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c878 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dd9f expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.478763:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.478789:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.478801:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.478834:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.478842:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.478849:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479814:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c88d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479828:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c88d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479837:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c88d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297450.479866:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 16384 00000004:00200000:1.0:1789297450.479870:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297450.479907:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c88d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479918:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479925:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479931:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479946:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297450.479952:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.479959:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480145:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:1.0:1789297450.480149:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297450.480153:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480160:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c87f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480172:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480177:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480183:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480188:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152aa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297450.480190:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480195:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480213:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff982a033cb200) 00010000:00010000:1.0:1789297450.480215:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297450.480218:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480224:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c886 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480262:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c878 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd9f expref: 8 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480275:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a400/0x8ad177e823a0c88d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd9f expref: 7 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.480282:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a033cbb00) 00010000:00010000:1.0:1789297450.480284:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1789297450.480287:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a400, rc 0) 00000100:00100000:1.0:1789297450.480436:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:14451:x1876213933129344:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 1817us (5316us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297450.480444:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00080000:2.0:1789297450.483245:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1789297450.493051:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.493192:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933129600 00000100:00100000:1.0:1789297450.493204:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933129600 00000100:00100000:1.0:1789297450.493264:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:1.0:1789297450.493274:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:14451:x1876213933129600:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297450.493297:0:15131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297450.493316:0:15131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c894 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dda6 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493411:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493427:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493438:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493454:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493461:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493468:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493862:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c8a9 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493872:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.493880:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c8a9 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297450.493890:0:15131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 16384 00010000:00010000:1.0:1789297450.494158:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494175:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494182:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494188:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152aa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297450.494193:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494201:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494217:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff982a033cbb00) 00010000:00010000:1.0:1789297450.494220:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297450.494225:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494232:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0c89b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494246:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494252:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494259:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494264:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297450.494273:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494279:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494287:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff982a033cb200) 00010000:00010000:1.0:1789297450.494290:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297450.494293:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494298:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c8a2 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494860:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c894 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dda6 expref: 10 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494876:0:15131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152ba00/0x8ad177e823a0c8a9 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dda6 expref: 9 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.494885:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a033cb000) 00010000:00010000:1.0:1789297450.494887:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1789297450.494890:0:15131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152ba00, rc 0) 00000100:00100000:1.0:1789297450.498192:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276ced80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14451:x1876213933129600:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 4904us (5136us total) trans 8589934593 rc 0/0 00000100:00100000:1.0:1789297450.498205:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:3.0:1789297450.522264:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.522659:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933129728 00000100:00100000:1.0:1789297450.522673:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933129728 00000100:00100000:1.0:1789297450.522804:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:1.0:1789297450.522817:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14451:x1876213933129728:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1789297450.523044:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14451:x1876213933129728:12345-192.168.202.43@tcp:59:lhsmtool_posix.0 Request processed in 228us (793us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297450.523052:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:0.0:1789297450.572262:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297450.572379:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933129856 00000100:00100000:2.0:1789297450.572392:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933129856 00000100:00100000:2.0:1789297450.572460:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:2.0:1789297450.572471:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14457:x1876213933129856:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297450.572495:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297450.572522:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8b7 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddad expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572591:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572607:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572620:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572637:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572645:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572651:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572954:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572981:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572988:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.572995:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297450.573001:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573010:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573025:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:2.0:1789297450.573028:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297450.573033:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573039:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8be lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573053:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573059:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573064:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573143:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297450.573152:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573158:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573166:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982b2ac85600) 00010000:00010000:2.0:1789297450.573169:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297450.573172:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573177:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8c5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573216:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8b7 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddad expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573227:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:2.0:1789297450.573229:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297450.573232:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8b7 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddad expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.573241:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256800, rc 0) 00000100:00100000:2.0:1789297450.573384:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276ce300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14457:x1876213933129856:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 913us (1132us total) trans 0 rc 301/301 00000100:00100000:2.0:1789297450.573392:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:0.0:1789297450.590208:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297450.590928:0:14434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933129984 00000100:00100000:3.0:1789297450.590946:0:14434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933129984 00000100:00100000:0.0:1789297450.591083:0:14435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297450.591096:0:14435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14457:x1876213933129984:12345-192.168.202.43@tcp:700:lfs.0 00000100:00100000:0.0:1789297450.591209:0:14435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cc380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14457:x1876213933129984:12345-192.168.202.43@tcp:700:lfs.0 Request processed in 115us (1012us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297450.591217:0:14435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:3.0:1789297450.593790:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297450.595041:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933130240 00000100:00100000:2.0:1789297450.595056:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933130240 00000100:00100000:2.0:1789297450.595295:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:2.0:1789297450.595307:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14457:x1876213933130240:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:2.0:1789297450.595448:0:14427:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297450.595479:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c7fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd28 expref: 9 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.595563:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:2.0:1789297450.595569:0:14427:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1789297450.595891:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.595908:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 5 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.595918:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.595955:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 5 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.595969:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 5 pid: 14427 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297450.595983:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1876213957239296:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297450.596098:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395f00 going to sleep for 11 seconds 00000100:00100000:1.0:1789297450.601329:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297450.601856:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933130368 00000100:00100000:0.0:1789297450.601870:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933130368 00010000:00010000:0.0:1789297450.601935:0:14411:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 6 pid: 14427 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297450.601976:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:0.0:1789297450.601985:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68d12f81-8505-4ba9-b09f-f083255d6291+6:2353:x1876213933130368:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1789297450.602000:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297450.602008:0:14411:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 5/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 6 pid: 14427 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.602024:0:14411:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 6 pid: 14427 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.602049:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:0.0:1789297450.602056:0:14411:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.602066:0:14411:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.602073:0:14411:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.602093:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1789297450.602172:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:68d12f81-8505-4ba9-b09f-f083255d6291+6:2353:x1876213933130368:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 187us (855us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297450.602179:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00010000:00010000:3.0:1789297450.603240:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0c832 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dd8a expref: 5 pid: 14427 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297450.603267:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1880 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1876213957239296:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297450.603290:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.603310:0:14427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.603316:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.603341:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.603353:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.603363:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1789297450.604887:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00200000:3.0:1789297450.607582:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789297450.607603:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.607613:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.607621:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.607629:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297450.607634:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.607643:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.607675:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982a033cbd00) 00010000:00010000:3.0:1789297450.607678:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297450.607684:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.607690:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256800/0x8ad177e823a0c8cc lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297450.607807:0:14427:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005c1c1ad6 reply state 00000000ffa60989 transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297450.607820:0:14427:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297450.608028:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+10:14457:x1876213933130240:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 12719us (14256us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789297450.608038:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00010000:00010000:2.0:1789297450.625882:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.625901:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.625929:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.625936:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27938800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297450.625941:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.625950:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.625968:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982b03073f00) 00010000:00010000:2.0:1789297450.625972:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297450.625976:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.625982:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938800/0x8ad177e823a0c8d3 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297450.728589:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297450.728683:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933130496 00000100:00100000:2.0:1789297450.728693:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933130496 00000100:00100000:2.0:1789297450.728769:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:2.0:1789297450.728793:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+9:14465:x1876213933130496:12345-192.168.202.43@tcp:101:lctl.0 00010000:00010000:2.0:1789297450.728818:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297450.728838:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8da lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddb4 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.728891:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8e1 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.728916:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.728924:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297450.728953:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789297450.728955:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297450.729005:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8e1 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.729030:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8da lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddb4 expref: 11 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.729050:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257000/0x8ad177e823a0c8e1 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddb4 expref: 10 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.729058:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:2.0:1789297450.729061:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297450.729064:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257000, rc 0) 00000100:00100000:2.0:1789297450.729136:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cd880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+10:14465:x1876213933130496:12345-192.168.202.43@tcp:101:lctl.0 Request processed in 345us (554us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297450.729142:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:1.0:1789297450.761097:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297450.761332:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933130624 00000100:00100000:3.0:1789297450.761344:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933130624 00000100:00100000:3.0:1789297450.761428:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:3.0:1789297450.761439:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68d12f81-8505-4ba9-b09f-f083255d6291+5:14466:x1876213933130624:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297450.761465:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297450.761489:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c8e8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddbb expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.761571:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938200/0x8ad177e823a0c8ef lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.761586:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938200/0x8ad177e823a0c8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.761615:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938200/0x8ad177e823a0c8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297450.761650:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789297450.761654:0:14425:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297450.761673:0:14425:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938200/0x8ad177e823a0c8ef lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.761697:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c8e8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddbb expref: 7 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.761786:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938200/0x8ad177e823a0c8ef lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddbb expref: 6 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.761796:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:3.0:1789297450.761799:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297450.761802:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b27938200, rc 0) 00000100:00100000:3.0:1789297450.762144:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68d12f81-8505-4ba9-b09f-f083255d6291+6:14466:x1876213933130624:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 706us (1068us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297450.762153:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:0.0:1789297450.770479:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297450.771351:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933130752 00000100:00100000:2.0:1789297450.771363:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933130752 00000100:00100000:2.0:1789297450.771548:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:2.0:1789297450.772338:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68d12f81-8505-4ba9-b09f-f083255d6291+6:14466:x1876213933130752:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297450.772362:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297450.772407:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8f6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddc2 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.772478:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.772501:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.772514:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.772527:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.772534:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.772540:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776050:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c90b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776072:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776093:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297450.776135:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:2.0:1789297450.776140:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:2.0:1789297450.776170:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c90b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776214:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776220:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776227:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776233:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256e00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297450.776237:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776244:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776256:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:2.0:1789297450.776259:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297450.776263:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776268:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256e00/0x8ad177e823a0c8fd lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776280:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776286:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776290:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776300:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257c00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297450.776303:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776309:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776327:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982b2ac85700) 00010000:00010000:2.0:1789297450.776330:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297450.776333:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776340:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c904 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776389:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c8f6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddc2 expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776405:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c90b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddc2 expref: 7 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.776412:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:2.0:1789297450.776415:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1789297450.776417:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257600, rc 0) 00000100:00100000:2.0:1789297450.776511:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68d12f81-8505-4ba9-b09f-f083255d6291+7:14466:x1876213933130752:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 4183us (6044us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297450.776520:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 22 00000100:00100000:0.0:1789297450.783301:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297450.783452:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933131008 00000100:00100000:2.0:1789297450.783476:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933131008 00000100:00100000:2.0:1789297450.783539:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:2.0:1789297450.783550:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68d12f81-8505-4ba9-b09f-f083255d6291+7:14466:x1876213933131008:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297450.783574:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297450.783597:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0c912 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddc9 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297450.783694:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789297450.783874:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0c912 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddc9 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.783891:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:2.0:1789297450.783894:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789297450.783899:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257800/0x8ad177e823a0c912 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddc9 expref: 9 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.783913:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257800, rc 0) 00000100:00100000:2.0:1789297450.783972:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:68d12f81-8505-4ba9-b09f-f083255d6291+8:14466:x1876213933131008:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 424us (683us total) trans 8589934595 rc 301/301 00000100:00100000:2.0:1789297450.783979:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 23 00000100:00100000:0.0:1789297450.788890:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.788949:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933131264 00000100:00100000:1.0:1789297450.788960:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933131264 00000100:00100000:1.0:1789297450.789070:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:1.0:1789297450.789081:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+8:14466:x1876213933131264:12345-192.168.202.43@tcp:36:lfs.0 00010000:00010000:1.0:1789297450.789137:0:15131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297450.789178:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257600/0x8ad177e823a0c90b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddc2 expref: 8 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.789197:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982b2ac85200) 00010000:00010000:1.0:1789297450.789209:0:15131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1789297450.789235:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.789248:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.789258:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1789297450.789485:0:15131:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e58da99f reply state 000000005c2c6d42 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297450.789505:0:15131:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1789297450.789520:0:15131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000100:00100000:1.0:1789297450.789610:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cdf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:68d12f81-8505-4ba9-b09f-f083255d6291+9:14466:x1876213933131264:12345-192.168.202.43@tcp:36:lfs.0 Request processed in 530us (726us total) trans 8589934596 rc 0/0 00000100:00100000:1.0:1789297450.789617:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 24 00000100:00100000:0.0:1789297450.792528:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.792628:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933131520 00000100:00100000:1.0:1789297450.792637:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933131520 00000100:00100000:1.0:1789297450.792696:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:1.0:1789297450.792727:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68d12f81-8505-4ba9-b09f-f083255d6291+9:14466:x1876213933131520:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:1.0:1789297450.792999:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68d12f81-8505-4ba9-b09f-f083255d6291+10:14466:x1876213933131520:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 294us (479us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1789297450.793008:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00010000:00010000:2.0:1789297450.793650:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.793664:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.793673:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.793696:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297450.794127:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.794139:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.794156:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982a033cb200) 00010000:00010000:2.0:1789297450.794159:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:2.0:1789297450.794164:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.794171:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0c920 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297450.800655:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297450.801009:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933131776 00000100:00100000:3.0:1789297450.801020:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933131776 00000100:00100000:3.0:1789297450.801087:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:3.0:1789297450.801097:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68d12f81-8505-4ba9-b09f-f083255d6291+9:14466:x1876213933131776:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297450.801121:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297450.801141:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c927 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddd0 expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801234:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801248:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801262:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801277:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801284:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801290:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297450.801405:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:3.0:1789297450.801499:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801508:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801514:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801520:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27938400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297450.801524:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801542:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801632:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:3.0:1789297450.801636:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297450.801640:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801646:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c92e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801663:0:14425:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801669:0:14425:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801675:0:14425:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801680:0:14425:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27939a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297450.801683:0:14425:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801689:0:14425:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801695:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982b03073600) 00010000:00010000:3.0:1789297450.801697:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297450.801700:0:14425:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801745:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c935 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801807:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c927 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd0 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.801819:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:3.0:1789297450.802023:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1789297450.802029:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c927 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd0 expref: 11 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.802041:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b27939600, rc 0) 00000100:00100000:3.0:1789297450.802405:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cfb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68d12f81-8505-4ba9-b09f-f083255d6291+10:14466:x1876213933131776:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 1308us (1760us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1789297450.802414:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 25 00000100:00100000:0.0:1789297450.811561:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297450.811695:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933131904 00000100:00100000:3.0:1789297450.811735:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933131904 00000100:00100000:3.0:1789297450.811807:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:3.0:1789297450.811817:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b276cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68d12f81-8505-4ba9-b09f-f083255d6291+10:14466:x1876213933131904:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297450.811863:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297450.811894:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c943 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddd7 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.811994:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.812009:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.812035:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297450.812061:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:3.0:1789297450.812065:0:14426:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:3.0:1789297450.812083:0:14426:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.812109:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c943 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 12 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.812133:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 11 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.812142:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297450.812145:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1789297450.812148:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b27939e00, rc 0) 00000100:00100000:3.0:1789297450.812218:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b276cf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:68d12f81-8505-4ba9-b09f-f083255d6291+11:14466:x1876213933131904:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 402us (677us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297450.812226:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 26 00000100:00100000:0.0:1789297450.817797:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.818045:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933132032 00000100:00100000:1.0:1789297450.818057:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933132032 00000100:00100000:1.0:1789297450.818118:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:1.0:1789297450.818127:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68d12f81-8505-4ba9-b09f-f083255d6291+11:14466:x1876213933132032:12345-192.168.202.43@tcp:37:lfs.0 00000100:00100000:1.0:1789297450.823087:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:68d12f81-8505-4ba9-b09f-f083255d6291+11:14466:x1876213933132032:12345-192.168.202.43@tcp:37:lfs.0 Request processed in 4949us (5301us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297450.823099:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:0.0:1789297450.826932:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297450.827122:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933132288 00000100:00100000:2.0:1789297450.827134:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933132288 00000100:00100000:2.0:1789297450.827232:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:2.0:1789297450.827243:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41f73050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68d12f81-8505-4ba9-b09f-f083255d6291+11:14466:x1876213933132288:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:2.0:1789297450.827555:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41f73050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:68d12f81-8505-4ba9-b09f-f083255d6291+12:14466:x1876213933132288:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 303us (623us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789297450.827563:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:1.0:1789297450.884456:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297450.884579:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933132416 00000100:00100000:0.0:1789297450.884592:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933132416 00000100:00100000:0.0:1789297450.884659:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:0.0:1789297450.884672:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+10:14472:x1876213933132416:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:0.0:1789297450.884693:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297450.884813:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c951 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddde expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.884885:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.884900:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.884911:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.884926:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.884932:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.884938:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885071:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031000/0x8ad177e823a0c966 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885086:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031000/0x8ad177e823a0c966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885093:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031000/0x8ad177e823a0c966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297450.885120:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00000004:00200000:0.0:1789297450.885123:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 18446744073709551615 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297450.885173:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031000/0x8ad177e823a0c966 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885187:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885194:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885200:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885207:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297450.885212:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885219:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885231:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:0.0:1789297450.885240:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297450.885246:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885252:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0c958 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885268:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885273:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885279:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885284:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00030000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297450.885287:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885293:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885301:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff982b088be100) 00010000:00010000:0.0:1789297450.885303:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297450.885306:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885310:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c95f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885340:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c951 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddde expref: 12 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885365:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031000/0x8ad177e823a0c966 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddde expref: 11 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297450.885373:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982b03073a00) 00010000:00010000:0.0:1789297450.885375:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1789297450.885377:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031000, rc 0) 00000100:00100000:0.0:1789297450.885441:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+11:14472:x1876213933132416:12345-192.168.202.43@tcp:101:bash.0 Request processed in 772us (996us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297450.885449:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 27 00000100:00100000:0.0:1789297450.891790:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297450.891963:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933132672 00000100:00100000:3.0:1789297450.891976:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933132672 00000100:00100000:3.0:1789297450.892049:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:3.0:1789297450.892059:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+11:14472:x1876213933132672:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:3.0:1789297450.892192:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297450.892216:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c96d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57dde5 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.892356:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.892383:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 11 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.892392:0:14426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.892424:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 11 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.892437:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 11 pid: 14426 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297450.892451:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1876213957239424:192.168.202.43@tcp:104: 00000100:00100000:3.0:1789297450.892813:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05304840 going to sleep for 11 seconds 00000100:00100000:3.0:1789297450.896033:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41ee6d80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1876213957239424:192.168.202.43@tcp:104: 00010000:00010000:3.0:1789297450.896067:0:14426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297450.897588:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.897741:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933132800 00000100:00100000:1.0:1789297450.897753:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933132800 00010000:00010000:1.0:1789297450.897809:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 12 pid: 14426 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297450.897861:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:1.0:1789297450.897872:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68d12f81-8505-4ba9-b09f-f083255d6291+12:2354:x1876213933132800:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297450.897888:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297450.897912:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 12 pid: 14426 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.897925:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 12 pid: 14426 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.897964:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939e00/0x8ad177e823a0c94a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddd7 expref: 12 pid: 14426 timeout: 562 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.897984:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982b03073a00) 00010000:00010000:1.0:1789297450.897989:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.897999:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.898007:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.898039:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297450.898429:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:68d12f81-8505-4ba9-b09f-f083255d6291+11:2354:x1876213933132800:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 556us (847us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297450.898438:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00010000:00010000:3.0:1789297450.898690:0:14426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.898699:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.898783:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.898803:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.898811:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.899528:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.899539:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900248:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297450.900263:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789297450.900302:0:14426:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900309:0:14426:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900315:0:14426:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900321:0:14426:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27939600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:3.0:1789297450.900325:0:14426:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900334:0:14426:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900362:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982b03073a00) 00010000:00010000:3.0:1789297450.900365:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1789297450.900370:0:14426:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900376:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c974 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297450.900395:0:14426:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000001c224149 reply state 0000000086dfa295 transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297450.900404:0:14426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1789297450.900442:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c96d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 14 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900457:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 13 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297450.900465:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:3.0:1789297450.900467:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1789297450.900470:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b27938400, rc 0) 00000100:00100000:2.0:1789297450.901877:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:14472:x1876213933132672:12345-192.168.202.43@tcp:101:bash.0 Request processed in 9810us (10097us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789297450.901888:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00010000:00010000:2.0:1789297450.905517:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.905567:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.905575:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.905582:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27939a00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297450.905587:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.905596:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.905614:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff982b03073600) 00010000:00010000:2.0:1789297450.905618:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297450.905622:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297450.905628:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939a00/0x8ad177e823a0c97b lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297450.928861:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297450.929609:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933132928 00000100:00100000:1.0:1789297450.929620:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933132928 00000100:00100000:1.0:1789297450.929758:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:1.0:1789297450.929769:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+13:14472:x1876213933132928:12345-192.168.202.43@tcp:101:bash.0 00010000:00010000:1.0:1789297450.929807:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297450.929828:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c990 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddec expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.929915:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.929931:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.929942:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1789297450.929987:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:1.0:1789297450.929991:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1789297450.930015:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.930026:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.930049:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b600/0x8ad177e823a0c990 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.930068:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 14 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297450.930077:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:1.0:1789297450.930080:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297450.930084:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a800, rc 0) 00000100:00100000:1.0:1789297450.930145:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:14472:x1876213933132928:12345-192.168.202.43@tcp:101:bash.0 Request processed in 378us (1295us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297450.930166:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:0.0:1789297450.933357:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297450.933818:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933133184 00000100:00100000:3.0:1789297450.933830:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933133184 00000100:00100000:3.0:1789297450.933896:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:3.0:1789297450.933907:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:14472:x1876213933133184:12345-192.168.202.43@tcp:35:bash.0 00000100:00100000:3.0:1789297450.934273:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+15:14472:x1876213933133184:12345-192.168.202.43@tcp:35:bash.0 Request processed in 367us (925us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1789297450.934281:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000100:00100000:0.0:1789297450.993285:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297450.993330:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297450.993367:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297450.993513:0:14420:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933133312 00000100:00100000:2.0:1789297450.993524:0:14420:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933133312 00000100:00100000:2.0:1789297450.993593:0:14420:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:2.0:1789297450.993604:0:14420:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b02eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2355:x1876213933133312:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297450.993680:0:14420:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b02eddc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2355:x1876213933133312:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 78us (405us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297450.993687:0:14420:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 121 00000100:00100000:0.0:1789297450.994294:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297450.996095:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.005112:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933133568 00000100:00100000:3.0:1789297451.005131:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933133568 00000100:00100000:3.0:1789297451.005223:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933133824 00000100:00100000:3.0:1789297451.005227:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933133824 00000100:00100000:3.0:1789297451.005245:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933133440 00000100:00100000:3.0:1789297451.005247:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933133440 00000100:00100000:3.0:1789297451.005268:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:3.0:1789297451.005278:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2355:x1876213933133568:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297451.005379:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2355:x1876213933133568:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 93us (12039us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297451.005387:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:3.0:1789297451.005406:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:3.0:1789297451.005413:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68d12f81-8505-4ba9-b09f-f083255d6291+5:2355:x1876213933133824:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297451.005438:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:68d12f81-8505-4ba9-b09f-f083255d6291+5:2355:x1876213933133824:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 27us (12072us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297451.005444:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:3.0:1789297451.005455:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:3.0:1789297451.005461:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2355:x1876213933133440:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:3.0:1789297451.005484:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2355:x1876213933133440:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 23us (11194us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297451.005489:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:1.0:1789297451.006332:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933133696 00000100:00100000:1.0:1789297451.006340:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933133696 00000100:00080000:3.0:1789297451.008950:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1789297451.008963:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1789297451.010996:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:0.0:1789297451.019400:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2355:x1876213933133696:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297451.019497:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2355:x1876213933133696:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 8489us (23411us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297451.019508:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:1.0:1789297451.038585:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297451.038655:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933134080 00000100:00100000:0.0:1789297451.038665:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933134080 00000100:00100000:2.0:1789297451.038746:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:2.0:1789297451.038759:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+15:14482:x1876213933134080:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:2.0:1789297451.038792:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297451.038810:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c99e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddf3 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297451.038896:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 16384 00010000:00010000:2.0:1789297451.039016:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c99e lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddf3 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.039031:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff982b2ac85600) 00010000:00010000:2.0:1789297451.039033:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1789297451.039039:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c99e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddf3 expref: 17 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.039054:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38256400, rc 0) 00000100:00100000:2.0:1789297451.039112:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+16:14482:x1876213933134080:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 356us (536us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1789297451.039120:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 30 00000100:00100000:1.0:1789297451.041531:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.041590:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933134336 00000100:00100000:3.0:1789297451.041599:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933134336 00000100:00100000:3.0:1789297451.041643:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:3.0:1789297451.041650:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+16:14482:x1876213933134336:12345-192.168.202.43@tcp:35:lfs.0 00000100:00100000:3.0:1789297451.041911:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+17:14482:x1876213933134336:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 261us (389us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789297451.041917:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:0.0:1789297451.077315:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.077380:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933134592 00000100:00100000:3.0:1789297451.077389:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933134592 00000100:00100000:3.0:1789297451.077441:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:3.0:1789297451.077450:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+17:14485:x1876213933134592:12345-192.168.202.43@tcp:101:lfs.0 00010000:00010000:3.0:1789297451.077475:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1789297451.077629:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9ac lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57ddfa expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.077745:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c9b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.077756:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.077765:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c9b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1789297451.077782:0:14425:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1789297451.077900:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9ac lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddfa expref: 20 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.077916:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c9b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddfa expref: 19 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.077923:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:3.0:1789297451.077936:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1789297451.077939:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b27939600, rc 0) 00000100:00100000:3.0:1789297451.077987:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:14485:x1876213933134592:12345-192.168.202.43@tcp:101:lfs.0 Request processed in 538us (679us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1789297451.078246:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 31 00000100:00100000:1.0:1789297451.080647:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297451.080689:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297451.080700:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933134720 00000100:00100000:0.0:1789297451.080743:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933134720 00000100:00100000:0.0:1789297451.080797:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:0.0:1789297451.080807:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:14485:x1876213933134720:12345-192.168.202.43@tcp:54:lfs.0 00010000:00010000:0.0:1789297451.080867:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.080880:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.080889:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.080909:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.080913:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.080918:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.080921:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00030000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297451.080924:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.081057:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.081071:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297451.081074:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297451.081077:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.081088:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c1 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297451.081149:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:14485:x1876213933134720:12345-192.168.202.43@tcp:54:lfs.0 Request processed in 343us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297451.081156:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 32 00000100:00100000:3.0:1789297451.083792:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933134848 00000100:00100000:3.0:1789297451.083806:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933134848 00000100:00100000:1.0:1789297451.084015:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297451.084055:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933135104 00000100:00100000:0.0:1789297451.084060:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933135104 00000100:00100000:2.0:1789297451.084093:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297451.084103:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:2.0:1789297451.084108:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:2353:x1876213933134848:12345-192.168.202.43@tcp:103:ldlm_bl.0 00000100:00100000:0.0:1789297451.084118:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:14485:x1876213933135104:12345-192.168.202.43@tcp:35:lfs.0 00010000:00010000:2.0:1789297451.084125:0:14411:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297451.084150:0:14411:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939600/0x8ad177e823a0c9b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddfa expref: 20 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.084169:0:14411:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:2.0:1789297451.084185:0:14411:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297451.084247:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:2353:x1876213933134848:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 144us (3557us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297451.084255:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297451.084339:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:14485:x1876213933135104:12345-192.168.202.43@tcp:35:lfs.0 Request processed in 226us (335us total) trans 8589934605 rc 0/0 00000100:00100000:0.0:1789297451.084345:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00010000:00010000:2.0:1789297451.198444:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1789297451.381155:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297451.381244:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933135360 00000100:00100000:0.0:1789297451.381256:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933135360 00000100:00100000:0.0:1789297451.381511:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:0.0:1789297451.381523:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:14516:x1876213933135360:12345-192.168.202.43@tcp:101:cat.0 00010000:00010000:0.0:1789297451.381549:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297451.381570:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c8 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de01 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.381664:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c9cf lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.381678:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c9cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.381763:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c9cf lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297451.381798:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789297451.381949:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9c8 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de01 expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.381979:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c9cf lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de01 expref: 21 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.381988:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297451.381991:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1789297451.381994:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031200, rc 0) 00000100:00100000:0.0:1789297451.382051:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+21:14516:x1876213933135360:12345-192.168.202.43@tcp:101:cat.0 Request processed in 530us (906us total) trans 8589934606 rc 0/0 00000100:00100000:0.0:1789297451.382070:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 33 00000100:00100000:1.0:1789297451.389587:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297451.389674:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.389826:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933135744 00000100:00100000:3.0:1789297451.389837:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933135744 00000100:00100000:3.0:1789297451.389905:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:3.0:1789297451.389916:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+21:2356:x1876213933135744:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297451.389932:0:14412:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297451.389968:0:14412:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0c9cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de01 expref: 21 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.389990:0:14412:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:3.0:1789297451.389995:0:14412:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297451.393262:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:2356:x1876213933135744:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 143us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297451.393289:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:2.0:1789297451.395216:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933135616 00000100:00100000:2.0:1789297451.395230:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933135616 00000100:00100000:2.0:1789297451.395305:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:2.0:1789297451.395317:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:14516:x1876213933135616:12345-192.168.202.43@tcp:35:cat.0 00000100:00100000:2.0:1789297451.396163:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+21:14516:x1876213933135616:12345-192.168.202.43@tcp:35:cat.0 Request processed in 844us (6582us total) trans 8589934607 rc 0/0 00000100:00100000:2.0:1789297451.396174:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 8 00000100:00100000:1.0:1789297451.446648:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297451.446742:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933136000 00000100:00100000:2.0:1789297451.446753:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933136000 00000100:00100000:2.0:1789297451.447342:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:2.0:1789297451.447353:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+21:14522:x1876213933136000:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:2.0:1789297451.447376:0:14426:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297451.447394:0:14426:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c9dd lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de08 expref: -99 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.447498:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.447514:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 22 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.447523:0:14426:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.447547:0:14426:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.447581:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 22 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.447595:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 22 pid: 14427 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297451.447610:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1876213957239552:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297451.447759:0:14426:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 22 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.447782:0:14426:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 22 pid: 14426 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297451.449276:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1876213957239680:192.168.202.43@tcp:104: 00000100:00100000:2.0:1789297451.449343:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b183959c0 going to sleep for 11 seconds 00000100:00100000:1.0:1789297451.459698:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.460529:0:16545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933136128 00000100:00100000:3.0:1789297451.460541:0:16545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933136128 00010000:00010000:3.0:1789297451.460584:0:16545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 23 pid: 14427 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297451.460633:0:16545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:3.0:1789297451.460644:0:16545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:2353:x1876213933136128:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1789297451.460677:0:16545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297451.460684:0:16545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 23 pid: 14427 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.460699:0:16545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 23 pid: 14427 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.460743:0:16545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:3.0:1789297451.460748:0:16545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.460756:0:16545:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.460763:0:16545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297451.460835:0:16545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ae5450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:2353:x1876213933136128:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 193us (1148us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297451.460843:0:16545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:0.0:1789297451.465652:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297451.466488:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933136256 00000100:00100000:1.0:1789297451.466504:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933136256 00010000:00010000:1.0:1789297451.466559:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 23 pid: 14426 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297451.466606:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:1.0:1789297451.466616:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:2354:x1876213933136256:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297451.466634:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297451.466642:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 5/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 23 pid: 14426 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297451.466656:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 23 pid: 14426 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297451.466688:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:1.0:1789297451.466751:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297451.466761:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297451.466778:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297451.466804:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297451.466858:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:2354:x1876213933136256:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 243us (1215us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297451.466865:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00010000:00010000:2.0:1789297451.469912:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0c997 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57ddec expref: 22 pid: 14427 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297451.469942:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca0380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1876213957239552:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297451.469959:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938400/0x8ad177e823a0c982 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57dde5 expref: 21 pid: 14426 timeout: 563 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297451.469994:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2a00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14426:1876213957239680:192.168.202.43@tcp:104: 00010000:00010000:2.0:1789297451.470020:0:14426:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.470030:0:14426:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.470037:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1789297451.470069:0:14426:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:2.0:1789297451.470252:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0c9dd lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de08 expref: 22 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.470268:0:14426:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38257c00/0x8ad177e823a0c9e4 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de08 expref: 21 pid: 14426 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.470278:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:2.0:1789297451.470281:0:14426:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1789297451.470284:0:14426:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257c00, rc 0) 00000100:00100000:2.0:1789297451.470359:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+21:14522:x1876213933136000:12345-192.168.202.43@tcp:101:dd.0 Request processed in 23008us (23722us total) trans 8589934608 rc 0/0 00000100:00100000:2.0:1789297451.470368:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 34 00000100:00100000:0.0:1789297451.480784:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.480992:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933136512 00000100:00100000:3.0:1789297451.481002:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933136512 00000100:00100000:3.0:1789297451.481070:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 35 00000100:00100000:3.0:1789297451.481082:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+21:14522:x1876213933136512:12345-192.168.202.43@tcp:36:dd.0 00010000:00010000:3.0:1789297451.481409:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.481427:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.481439:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1789297451.481496:0:14425:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1789297451.481531:0:14425:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000ed9af853 reply state 000000003900529c transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297451.481541:0:14425:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297451.481634:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14522:x1876213933136512:12345-192.168.202.43@tcp:36:dd.0 Request processed in 554us (869us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1789297451.481641:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 35 00000020:00080000:3.0:1789297451.481645:0:14425:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:1.0:1789297451.487722:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297451.488263:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933136640 00000100:00100000:0.0:1789297451.488274:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933136640 00000100:00100000:0.0:1789297451.488354:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 36 00000100:00100000:0.0:1789297451.488372:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14522:x1876213933136640:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:0.0:1789297451.488402:0:15131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297451.488426:0:15131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9f9 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de0f expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.488490:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de0f expref: 25 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.488518:0:15131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9f9 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de0f expref: 25 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.488539:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297451.488542:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297451.488545:0:15131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00030000, rc 0) 00000100:00100000:0.0:1789297451.488608:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38226a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+25:14522:x1876213933136640:12345-192.168.202.43@tcp:101:dd.0 Request processed in 245us (906us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297451.488615:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 36 00010000:00010000:2.0:1789297451.493512:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.493531:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.493557:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.493563:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27939000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297451.493568:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.493576:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.493594:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:2.0:1789297451.493597:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297451.493602:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297451.493609:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27939000/0x8ad177e823a0c9f2 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297451.514392:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.514512:0:16545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933136896 00000100:00100000:3.0:1789297451.514524:0:16545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933136896 00000100:00100000:3.0:1789297451.514581:0:16545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:3.0:1789297451.514590:0:16545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14522:x1876213933136896:12345-192.168.202.43@tcp:103:dd.0 00010000:00010000:3.0:1789297451.514606:0:16545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297451.514631:0:16545:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0c9f9 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de0f expref: 24 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297451.514653:0:16545:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:3.0:1789297451.514658:0:16545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1789297451.514755:0:16545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38224a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:14522:x1876213933136896:12345-192.168.202.43@tcp:103:dd.0 Request processed in 167us (374us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297451.514763:0:16545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000040:00080000:0.0:1789297451.522499:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1789297451.525225:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297451.525304:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933137024 00000100:00100000:3.0:1789297451.525315:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933137024 00000100:00100000:0.0:1789297451.525961:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:0.0:1789297451.525974:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:14522:x1876213933137024:12345-192.168.202.43@tcp:58:dd.0 00010000:00010000:0.0:1789297451.526301:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.526318:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.526330:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1789297451.529315:0:14427:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1789297451.530003:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:0.0:1789297451.530463:0:14427:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:0.0:1789297451.530664:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:14522:x1876213933137024:12345-192.168.202.43@tcp:58:dd.0 Request processed in 4687us (5442us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297451.530690:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 37 00000100:00100000:1.0:1789297451.537519:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297451.537619:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933137152 00000100:00100000:0.0:1789297451.537629:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933137152 00000100:00100000:0.0:1789297451.537693:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 38 00000100:00100000:0.0:1789297451.537734:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+23:14522:x1876213933137152:12345-192.168.202.43@tcp:101:dd.0 00010000:00010000:0.0:1789297451.537759:0:15131:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297451.537799:0:15131:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de16 expref: -99 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.537879:0:15131:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.537892:0:15131:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de16 expref: 24 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.537915:0:15131:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.537930:0:15131:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de16 expref: 24 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.537944:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297451.537947:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297451.537951:0:15131:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de16 expref: 24 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297451.537959:0:15131:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b00031a00, rc 0) 00000100:00100000:0.0:1789297451.538047:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14522:x1876213933137152:12345-192.168.202.43@tcp:101:dd.0 Request processed in 345us (539us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297451.538054:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 38 00010000:00010000:1.0:1789297452.221042:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1789297452.478024:0:3303:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1789297452.478049:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957239808:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1789297452.478124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297452.480426:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957239808 00000100:00100000:1.0:1789297452.480443:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957239808 00000100:00100000:1.0:1789297452.480533:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297452.480546:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957239808:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1789297452.480591:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1789297452.480695:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957239808:12345-0@lo:13:osp-pre-0-0.0 Request processed in 152us (2571us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297452.480731:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1789297452.480814:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957239808:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1789297452.482817:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000040:00080000:2.0:1789297452.544438:0:14458:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789297452.544448:0:14458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297452.544488:0:14458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789297452.544498:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1789297452.544860:0:14458:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14458:1876213957239936:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1789297452.544979:0:14458:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b18395780 going to sleep for 11 seconds 00000100:00100000:1.0:1789297452.549069:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.549189:0:14436:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933137280 00000100:00100000:0.0:1789297452.549199:0:14436:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933137280 00000100:00100000:0.0:1789297452.549269:0:14436:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297452.549281:0:14436:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+25:14523:x1876213933137280:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 00000100:00100000:0.0:1789297452.549365:0:14436:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+25:14523:x1876213933137280:12345-192.168.202.43@tcp:900:lhsmtool_posix.0 Request processed in 86us (304us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297452.549374:0:14436:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00080000:0.0:1789297452.549413:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1789297452.552001:0:14458:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca2a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14458:1876213957239936:192.168.202.43@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1789297452.553491:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.554787:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933137408 00000100:00100000:2.0:1789297452.554801:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933137408 00000100:00100000:2.0:1789297452.554889:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:2.0:1789297452.554918:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14523:x1876213933137408:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1789297452.554954:0:14425:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1789297452.555082:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14523:x1876213933137408:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 167us (1598us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.555091:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 39 00000100:00100000:3.0:1789297452.566207:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.567752:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933137536 00000100:00100000:0.0:1789297452.567779:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933137536 00000100:00100000:0.0:1789297452.567857:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:0.0:1789297452.567869:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14523:x1876213933137536:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 00010000:00010000:0.0:1789297452.567942:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.567961:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.567973:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.567990:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.567996:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568053:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568094:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568103:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568110:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297452.568151:0:15131:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1789297452.568155:0:15131:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297452.568170:0:15131:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568181:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568187:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568195:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568201:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031600 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.568205:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568214:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568232:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a033cb000) 00010000:00010000:0.0:1789297452.568235:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297452.568240:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568246:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031600/0x8ad177e823a0ca0e lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568260:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568266:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568272:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568278:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00030000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.568281:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568288:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568295:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff982b088be100) 00010000:00010000:0.0:1789297452.568298:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297452.568300:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568307:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00030000/0x8ad177e823a0ca15 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568332:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568338:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568345:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568350:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffb800 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.568353:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568360:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568368:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297452.568370:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297452.568373:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.568379:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca1c lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.568471:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14523:x1876213933137536:12345-192.168.202.43@tcp:34:lhsmtool_posix.0 Request processed in 604us (2273us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297452.568480:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 40 00000100:00100000:1.0:1789297452.575836:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.575952:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933137792 00000100:00100000:0.0:1789297452.575963:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933137792 00000100:00100000:0.0:1789297452.576025:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:0.0:1789297452.576042:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+24:14523:x1876213933137792:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297452.576064:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297452.576084:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de1d expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576179:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576196:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576208:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297452.576221:0:14427:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:0.0:1789297452.576318:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576326:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576334:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576341:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffac00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.576346:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576354:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576366:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297452.576375:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1789297452.576380:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576386:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca2a lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576432:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca23 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de1d expref: 26 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576444:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff982a033cb000) 00010000:00010000:0.0:1789297452.576445:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1789297452.576449:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de1d expref: 26 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.576458:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b40ffb400, rc 0) 00000100:00100000:0.0:1789297452.576528:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+25:14523:x1876213933137792:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 487us (704us total) trans 8589934611 rc 301/301 00000100:00100000:0.0:1789297452.576535:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 41 00000100:00100000:2.0:1789297452.586522:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.588942:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933137920 00000100:00100000:0.0:1789297452.588958:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933137920 00000100:00100000:0.0:1789297452.589025:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789297452.589036:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+25:14523:x1876213933137920:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1789297452.589074:0:15131:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1789297452.589239:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+25:14523:x1876213933137920:12345-192.168.202.43@tcp:53:lhsmtool_posix.0 Request processed in 204us (2726us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297452.589247:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 42 00000100:00100000:0.0:1789297452.599094:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297452.599218:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933138176 00000100:00100000:1.0:1789297452.599230:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933138176 00000100:00100000:1.0:1789297452.599299:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:1.0:1789297452.599309:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+25:14523:x1876213933138176:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297452.599334:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297452.599359:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca38 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de24 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1789297452.600275:0:14427:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:1.0:1789297452.600284:0:14427:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:1.0:1789297452.600339:0:14427:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:1.0:1789297452.604497:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0ca3f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.605468:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0ca3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.605489:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0ca3f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.608185:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca38 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de24 expref: 28 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.608225:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0ca3f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de24 expref: 27 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.608235:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb900) 00010000:00010000:1.0:1789297452.608238:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1789297452.608241:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152a800, rc 0) 00000100:00100000:1.0:1789297452.608357:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+27:14523:x1876213933138176:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 9047us (9272us total) trans 8589934612 rc 0/0 00000100:00100000:1.0:1789297452.608367:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 43 00000100:00100000:2.0:1789297452.616449:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.616676:0:15131:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933138432 00000100:00100000:0.0:1789297452.616686:0:15131:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933138432 00000100:00100000:0.0:1789297452.616797:0:15131:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:0.0:1789297452.616810:0:15131:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+27:14523:x1876213933138432:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1789297452.616879:0:15131:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1789297452.616910:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152a800/0x8ad177e823a0ca3f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de24 expref: 27 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.616931:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb900) 00010000:00010000:0.0:1789297452.616943:0:15131:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1789297452.616968:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.616983:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.616994:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617009:0:15131:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617016:0:15131:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617022:0:15131:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617095:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617120:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617127:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617133:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffb400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.617139:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617145:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617154:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff982b03073a00) 00010000:00010000:0.0:1789297452.617157:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297452.617160:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.617166:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca4d lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.619472:0:15131:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.619490:0:15131:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.619498:0:15131:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.619504:0:15131:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffac00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.619526:0:15131:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.619536:0:15131:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.619551:0:15131:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x4e882c9b (ffff982b088be100) 00010000:00010000:0.0:1789297452.619554:0:15131:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297452.619558:0:15131:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.619564:0:15131:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca54 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x4e882c9b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15131 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.619688:0:15131:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+26:14523:x1876213933138432:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 2877us (3245us total) trans 0 rc -2/-2 00000100:00100000:0.0:1789297452.619699:0:15131:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 44 00000100:00100000:2.0:1789297452.624000:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297452.624126:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933138560 00000100:00100000:1.0:1789297452.624136:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933138560 00000100:00100000:1.0:1789297452.624210:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:1.0:1789297452.624221:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+26:14523:x1876213933138560:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1789297452.624340:0:14425:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1789297452.624380:0:14425:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca5b lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de2b expref: -99 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.624428:0:14425:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0ca62 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.624443:0:14425:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0ca62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.624456:0:14425:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0ca62 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14425 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.624883:0:14425:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca5b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de2b expref: 28 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.624905:0:14425:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152b800/0x8ad177e823a0ca62 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de2b expref: 27 pid: 14425 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.624914:0:14425:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:1.0:1789297452.624917:0:14425:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1789297452.624929:0:14425:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b0152b800, rc 0) 00000100:00100000:1.0:1789297452.625053:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+27:14523:x1876213933138560:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 832us (1063us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297452.625061:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 45 00000100:00100000:3.0:1789297452.635922:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297452.636202:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933138816 00000100:00100000:1.0:1789297452.636213:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933138816 00000100:00100000:1.0:1789297452.636285:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:1.0:1789297452.636295:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+27:14523:x1876213933138816:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1789297452.636391:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.636410:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.636423:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1789297452.636835:0:14426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:1.0:1789297452.636847:0:14426:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 464511142230ns, next at 465511138680ns, rc = 0 00000004:00010000:1.0:1789297452.636943:0:14426:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c66eb59f reply state 00000000078bc383 transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297452.636954:0:14426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1789297452.637047:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+29:14523:x1876213933138816:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 751us (1132us total) trans 8589934613 rc 0/0 00000100:00100000:1.0:1789297452.637055:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 46 00000100:00100000:2.0:1789297452.640670:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.640862:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933138944 00000100:00100000:0.0:1789297452.640873:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933138944 00000100:00100000:0.0:1789297452.640935:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 47 00000100:00100000:0.0:1789297452.640946:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+29:14523:x1876213933138944:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297452.640972:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297452.640995:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de32 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.641054:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 30 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.641069:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 30 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.641103:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:0.0:1789297452.641107:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297452.641110:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b40ffac00, rc 0) 00000100:00100000:0.0:1789297452.641171:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+30:14523:x1876213933138944:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 226us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297452.641178:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 47 00010000:00010000:1.0:1789297452.642408:0:3288:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.642420:0:3288:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.642439:0:3288:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.642445:0:3288:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152aa00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:1.0:1789297452.642450:0:3288:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.642459:0:3288:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.642473:0:3288:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:1.0:1789297452.642476:0:3288:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1789297452.642479:0:3288:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.642486:0:3288:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b0152aa00/0x8ad177e823a0ca69 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297452.648890:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.649018:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933139072 00000100:00100000:3.0:1789297452.649028:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933139072 00000100:00100000:3.0:1789297452.649093:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00100000:3.0:1789297452.649105:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2355:x1876213933139072:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1789297452.649485:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2355:x1876213933139072:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 382us (604us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1789297452.649494:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 12 00000100:00080000:0.0:1789297452.650038:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789297452.656640:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297452.656728:0:14429:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933139328 00000100:00100000:1.0:1789297452.656738:0:14429:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933139328 00000100:00100000:1.0:1789297452.656866:0:14429:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789297452.656879:0:14429:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+29:14523:x1876213933139328:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1789297452.657152:0:14429:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+30:14523:x1876213933139328:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 275us (520us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1789297452.657160:0:14429:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 9 00000100:00100000:1.0:1789297452.659964:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.660077:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933139584 00000100:00100000:2.0:1789297452.660087:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933139584 00000100:00100000:2.0:1789297452.660147:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:2.0:1789297452.660166:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982a0299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+30:14523:x1876213933139584:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789297452.660290:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982a0299ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+30:14523:x1876213933139584:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 126us (345us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.660298:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 48 00000100:00100000:3.0:1789297452.663005:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.663197:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933139712 00000100:00100000:0.0:1789297452.663208:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933139712 00000100:00100000:0.0:1789297452.663275:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:0.0:1789297452.663286:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+30:14523:x1876213933139712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1789297452.663308:0:14427:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1789297452.663328:0:14427:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca77 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de39 expref: -99 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.663397:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca7e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.663409:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.663419:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1789297452.663453:0:14427:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1789297452.663472:0:14427:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca7e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.663521:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0ca77 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de39 expref: 32 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.663929:0:14427:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca7e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de39 expref: 31 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.663939:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:0.0:1789297452.663943:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1789297452.663947:0:14427:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b40ffb800, rc 0) 00000100:00100000:0.0:1789297452.664018:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+31:14523:x1876213933139712:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 734us (1023us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297452.664025:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 49 00000100:00100000:3.0:1789297452.666375:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.666488:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933139840 00000100:00100000:2.0:1789297452.666499:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933139840 00000100:00100000:2.0:1789297452.666554:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789297452.666564:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+6:2356:x1876213933139840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1789297452.666583:0:15109:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1789297452.666603:0:15109:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x1e2be6c37e57de40 expref: -99 pid: 15109 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297452.666633:0:15109:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6aa6832c, blocks: 0x1 00010000:00010000:2.0:1789297452.666653:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=464s v=(0 0) 00010000:00010000:2.0:1789297452.666671:0:15109:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297452.666681:0:15109:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 7 pid: 15109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.666741:0:15109:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 7 pid: 15109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.666767:0:15109:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff982b38257e00, rc 0) 00000100:00100000:2.0:1789297452.666832:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:2356:x1876213933139840:12345-192.168.202.43@tcp:101:lhsmtool_posix.0 Request processed in 269us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.666839:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:1.0:1789297452.669776:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.669977:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933140096 00000100:00100000:2.0:1789297452.669988:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933140096 00000100:00100000:2.0:1789297452.670046:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:2.0:1789297452.670056:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+31:14523:x1876213933140096:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1789297452.670161:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+31:14523:x1876213933140096:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 105us (402us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.670168:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 50 00000100:00100000:3.0:1789297452.672225:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.672763:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933140224 00000100:00100000:2.0:1789297452.672774:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933140224 00000100:00100000:2.0:1789297452.672833:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:2.0:1789297452.672844:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+31:14523:x1876213933140224:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 00000001:00080000:2.0:1789297452.718043:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934611 is committed 00000001:00080000:2.0:1789297452.718079:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:2.0:1789297452.718088:0:5864:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:2.0:1789297452.718102:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000100:00100000:2.0:1789297452.718278:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b39ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957240064:0@lo:2:osp-syn-1-0.0 00000100:00100000:2.0:1789297452.718486:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000001:00080000:2.0:1789297452.718595:0:5864:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:3.0:1789297452.718767:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957240064 00000100:00100000:3.0:1789297452.718776:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957240064 00000100:00080000:2.0:1789297452.718865:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1789297452.719107:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:14523:x1876213933140224:12345-192.168.202.43@tcp:44:lhsmtool_posix.0 Request processed in 46259us (46887us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297452.719118:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 51 00000100:00100000:3.0:1789297452.719184:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1789297452.719197:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3303:x1876213957240064:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:3.0:1789297452.719448:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789297452.719452:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:3.0:1789297452.719454:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:3.0:1789297452.719456:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789297452 -> 1789297452 00002000:00010000:3.0:1789297452.719459:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789297452.719584:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3303:x1876213957240064:12345-0@lo:2:osp-syn-1-0.0 Request processed in 389us (1227us total) trans 8589934595 rc 0/0 00000100:00100000:3.0:1789297452.719591:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:2.0:1789297452.719683:0:3303:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff982b39ca1500/2, rc 0, transno 8589934595 00000100:00100000:2.0:1789297452.719690:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b39ca1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3303:1876213957240064:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1789297452.722783:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.722907:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933140352 00000100:00100000:2.0:1789297452.722918:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933140352 00000100:00100000:2.0:1789297452.723021:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:2.0:1789297452.723033:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:2353:x1876213933140352:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 00000100:00100000:2.0:1789297452.723158:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:2353:x1876213933140352:12345-192.168.202.43@tcp:16:lhsmtool_posix.0 Request processed in 127us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.723166:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 15 00000100:00100000:1.0:1789297452.725579:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.725668:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933140608 00000100:00100000:3.0:1789297452.725693:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933140608 00000100:00100000:3.0:1789297452.725781:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 52 00000100:00100000:3.0:1789297452.725792:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:14523:x1876213933140608:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1789297452.725855:0:14426:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1789297452.725887:0:14426:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb800/0x8ad177e823a0ca7e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de39 expref: 14 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.725911:0:14426:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:3.0:1789297452.725916:0:14426:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1789297452.725955:0:14426:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.725970:0:14426:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.725983:0:14426:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1789297452.726197:0:14426:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b7b6bfbb reply state 0000000006194111 transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297452.726208:0:14426:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1789297452.726310:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+15:14523:x1876213933140608:12345-192.168.202.43@tcp:36:lhsmtool_posix.0 Request processed in 519us (741us total) trans 8589934615 rc 0/0 00000100:00100000:3.0:1789297452.726319:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 52 00010000:00010000:2.0:1789297452.728852:0:3289:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.728869:0:3289:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.728878:0:3289:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.728884:0:3289:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27938000 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:2.0:1789297452.728889:0:3289:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.728897:0:3289:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.728933:0:3289:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:2.0:1789297452.728937:0:3289:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1789297452.728943:0:3289:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.728950:0:3289:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b27938000/0x8ad177e823a0ca8c lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14426 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297452.730535:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.730654:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933140736 00000100:00100000:3.0:1789297452.730668:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933140736 00000100:00100000:3.0:1789297452.730779:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:3.0:1789297452.730791:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+7:2353:x1876213933140736:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 00002000:00010000:3.0:1789297452.731031:0:15107:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:3.0:1789297452.731035:0:15107:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1789297451 00002000:00010000:3.0:1789297452.731038:0:15107:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1789297451 00002000:00010000:3.0:1789297452.731041:0:15107:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789297452 -> 1789297451 00002000:00010000:3.0:1789297452.731043:0:15107:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:3.0:1789297452.731113:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+8:2353:x1876213933140736:12345-192.168.202.43@tcp:2:lhsmtool_posix.0 Request processed in 322us (584us total) trans 8589934596 rc 0/0 00000100:00100000:3.0:1789297452.731121:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 16 00000100:00100000:3.0:1789297452.734549:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.734646:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933140864 00000100:00100000:0.0:1789297452.734658:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933140864 00000100:00100000:0.0:1789297452.734753:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:0.0:1789297452.734778:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+8:2354:x1876213933140864:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1789297452.734825:0:15110:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734843:0:15110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297452.734849:0:15110:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297452.734854:0:15110:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734892:0:15110:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734924:0:15110:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734934:0:15110:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734943:0:15110:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734951:0:15110:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffb400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297452.734956:0:15110:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734966:0:15110:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734981:0:15110:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.734989:0:15110:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbaa94cc/0x8ad177e823a0ca93 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15110 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.735085:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41ee6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+8:2354:x1876213933140864:12345-192.168.202.43@tcp:1:lhsmtool_posix.0 Request processed in 309us (546us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297452.735092:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 17 00000100:00100000:2.0:1789297452.737338:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297452.737435:0:14427:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933141120 00000100:00100000:0.0:1789297452.737444:0:14427:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933141120 00000100:00100000:0.0:1789297452.737503:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 53 00000100:00100000:0.0:1789297452.737513:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:14523:x1876213933141120:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1789297452.737593:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.737611:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.737623:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.737917:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.737930:0:14427:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.737938:0:14427:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.737976:0:14427:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 15 pid: 14427 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.738004:0:14427:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 15 pid: 14427 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.738020:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1876213957240192:192.168.202.43@tcp:104: 00000100:00100000:0.0:1789297452.738113:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969240 going to sleep for 11 seconds 00000100:00100000:1.0:1789297452.744171:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.744282:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933141248 00000100:00100000:2.0:1789297452.744293:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933141248 00010000:00010000:2.0:1789297452.744340:0:14410:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 16 pid: 14427 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297452.744395:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 13 00000100:00100000:2.0:1789297452.744407:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+16:2354:x1876213933141248:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1789297452.744424:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1789297452.744431:0:14410:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 16 pid: 14427 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.744445:0:14410:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 16 pid: 14427 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.744473:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:2.0:1789297452.744489:0:14410:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.744519:0:14410:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.744526:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.744546:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1789297452.744607:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621f800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+16:2354:x1876213933141248:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 202us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.744615:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 13 00010000:00010000:0.0:1789297452.745294:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffac00/0x8ad177e823a0ca70 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de32 expref: 15 pid: 14427 timeout: 564 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.745314:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1876213957240192:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297452.745337:0:14427:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.745347:0:14427:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.745366:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1789297452.745582:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1789297452.745841:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1789297452.745893:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1789297452.745987:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14427:1876213957240320:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789297452.746067:0:14427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297452.746104:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969f00 going to sleep for 11 seconds 00000100:00100000:2.0:1789297452.746639:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957240320 00000100:00100000:2.0:1789297452.746648:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957240320 00000100:00100000:2.0:1789297452.746701:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1789297452.746742:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14427:x1876213957240320:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789297452.746851:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14427:x1876213957240320:12345-0@lo:1000:mdt00_002.0 Request processed in 111us (784us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.746858:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1789297452.746992:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14427:1876213957240320:0@lo:1000:mdt00_002.0 00000001:00080000:0.0:1789297452.752607:0:14427:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1789297452.752752:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14427:1876213957240448:0@lo:1000:mdt00_002.0 00000100:00100000:0.0:1789297452.752855:0:14427:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297452.752900:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969240 going to sleep for 11 seconds 00000100:00100000:2.0:1789297452.753140:0:14430:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957240448 00000100:00100000:2.0:1789297452.753149:0:14430:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957240448 00000100:00100000:2.0:1789297452.753211:0:14430:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1789297452.753223:0:14430:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14427:x1876213957240448:12345-0@lo:1000:mdt00_002.0 00000100:00100000:2.0:1789297452.753462:0:14430:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14427:x1876213957240448:12345-0@lo:1000:mdt00_002.0 Request processed in 241us (605us total) trans 8589934597 rc 0/0 00000100:00100000:2.0:1789297452.753471:0:14430:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1789297452.753839:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16d80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-mdtlov_UUID:14427:1876213957240448:0@lo:1000:mdt00_002.0 00010000:00010000:0.0:1789297452.753884:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753895:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753902:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753909:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffbc00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.753914:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753922:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753937:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:0.0:1789297452.753941:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297452.753946:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753954:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffbc00/0x8ad177e823a0caa1 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753988:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.753995:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.754009:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.754014:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b00031200 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.754017:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.754024:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.754033:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297452.754035:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1789297452.754042:0:14427:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de16 expref: 18 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.754054:0:14427:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de16 expref: 18 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.754062:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de16 expref: 18 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.754093:0:14427:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031a00/0x8ad177e823a0ca07 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de16 expref: 18 pid: 15131 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.754106:0:14427:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b41e16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1876213957240576:192.168.202.43@tcp:105: 00000100:00100000:0.0:1789297452.754180:0:14427:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b05969240 going to sleep for 11 seconds 00000100:00100000:0.0:1789297452.756971:0:14427:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b41e16a00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:14427:1876213957240576:192.168.202.43@tcp:105: 00010000:00010000:0.0:1789297452.757027:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757038:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b00031200/0x8ad177e823a0ca00 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757081:0:14427:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757096:0:14427:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757111:0:14427:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757122:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757128:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757136:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757142:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffb400 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.757147:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757154:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757165:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297452.757174:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1789297452.757179:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757184:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffb400/0x8ad177e823a0caa8 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757195:0:14427:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757201:0:14427:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757208:0:14427:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757212:0:14427:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffae00 already unused, calling callback (ffffffffc20ad4f0) 00010000:00010000:0.0:1789297452.757215:0:14427:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757220:0:14427:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757228:0:14427:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff982b03073200) 00010000:00010000:0.0:1789297452.757230:0:14427:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1789297452.757232:0:14427:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.757238:0:14427:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b40ffae00/0x8ad177e823a0ca9a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14427 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.757507:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+18:14523:x1876213933141120:12345-192.168.202.43@tcp:57:lhsmtool_posix.0 Request processed in 19993us (20177us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1789297452.757530:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 53 00000020:00080000:0.0:1789297452.757536:0:14427:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1789297452.761228:0:14458:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789297452.761237:0:14458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297452.761265:0:14458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789297452.761286:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:3.0:1789297452.766263:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.766310:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.766399:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933141376 00000100:00100000:2.0:1789297452.766410:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933141376 00000100:00100000:2.0:1789297452.766449:0:14428:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933141632 00000100:00100000:2.0:1789297452.766452:0:14428:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933141632 00000100:00100000:2.0:1789297452.766466:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297452.766475:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41f73850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:14522:x1876213933141376:12345-192.168.202.43@tcp:49:dd.0 00000100:00100000:2.0:1789297452.766623:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41f73850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:14522:x1876213933141376:12345-192.168.202.43@tcp:49:dd.0 Request processed in 148us (371us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297452.766632:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 10 00000100:00100000:2.0:1789297452.766675:0:14428:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 11 00000100:00100000:2.0:1789297452.766682:0:14428:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+18:14523:x1876213933141632:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1789297452.768073:0:14428:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1789297452.768198:0:14428:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1789297452.768262:0:14428:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.768287:0:14428:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.768300:0:14428:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.768309:0:14428:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.768316:0:14428:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.768322:0:14428:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297452.768348:0:14428:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1789297452.768843:0:15698:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1789297452.768852:0:15698:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.768859:0:15698:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297452.768863:0:15698:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.768871:0:15698:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.768885:0:15698:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff982a033cb200) 00010000:00010000:3.0:1789297452.768888:0:15698:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1789297452.768892:0:15698:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.768898:0:15698:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff982b38256400/0x8ad177e823a0caaf lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14428 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.768924:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297452.768926:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1789297452.768927:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1789297452.769448:0:14428:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:14523:x1876213933141632:12345-192.168.202.43@tcp:35:lhsmtool_posix.0 Request processed in 2759us (3130us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1789297452.769460:0:14428:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 11 00000020:00080000:2.0:1789297452.769466:0:14428:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1789297452.946841:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297452.947007:0:15113:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933141760 00000100:00100000:1.0:1789297452.947019:0:15113:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933141760 00000100:00100000:1.0:1789297452.947093:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:1.0:1789297452.947114:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+8:2355:x1876213933141760:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:1.0:1789297452.947150:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.947173:0:15113:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 8 pid: 15109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.947181:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.947186:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.947191:0:15113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.947226:0:15113:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 8 pid: 15109 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.947241:0:15113:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 8 pid: 15109 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297452.947256:0:15113:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15113:1876213957240704:192.168.202.43@tcp:104: 00000100:00100000:1.0:1789297452.947347:0:15113:0:(client.c:2715:ptlrpc_set_wait()) set ffff982b02c17180 going to sleep for 11 seconds 00000100:00100000:3.0:1789297452.957665:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.957750:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.957817:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.957850:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.957898:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789297452.957906:0:15114:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:3.0:1789297452.958083:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142016 00000100:00100000:3.0:1789297452.958093:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142016 00000100:00100000:3.0:1789297452.958151:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789297452.958159:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142144 00000100:00100000:3.0:1789297452.958161:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142144 00000100:00100000:3.0:1789297452.958174:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:3.0:1789297452.958178:0:15114:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142272 00000100:00100000:3.0:1789297452.958180:0:15114:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142272 00000100:00100000:3.0:1789297452.959173:0:16661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:3.0:1789297452.959193:0:16661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+11:2355:x1876213933142016:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:3.0:1789297452.959242:0:16661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.959265:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297452.959271:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1789297452.959277:0:16661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.959287:0:16661:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297452.960273:0:16545:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933141888 00000100:00100000:1.0:1789297452.960294:0:16545:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933141888 00010000:00010000:1.0:1789297452.960329:0:16545:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 12 pid: 15109 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297452.960379:0:16545:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 14 00000100:00100000:1.0:1789297452.960389:0:16545:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+12:2354:x1876213933141888:12345-192.168.202.43@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1789297452.960401:0:16545:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1789297452.960423:0:16545:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 12 pid: 15109 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.960437:0:16545:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 12 pid: 15109 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.960461:0:16545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.960466:0:16545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.960470:0:16545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.960493:0:16545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50090000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.960502:0:16545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.960505:0:16545:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.960508:0:16545:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.960516:0:16545:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.960548:0:16545:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1789297452.960616:0:16545:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+12:2354:x1876213933141888:12345-192.168.202.43@tcp:103:ldlm_bl.0 Request processed in 228us (2962us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297452.960624:0:16545:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 14 00010000:00010000:0.0:1789297452.961619:0:15113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050dc186e/0x8ad177e823a0ca85 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.202.43@tcp remote: 0x1e2be6c37e57de40 expref: 11 pid: 15109 timeout: 564 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297452.961640:0:15113:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621d180 pname:cluuid:pid:xid:nid:opc:job ll_ost_io00_000:lustre-OST0001_UUID:15113:1876213957240704:192.168.202.43@tcp:104: 00010000:00010000:0.0:1789297452.961662:0:15113:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.961743:0:15113:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297452.961761:0:15113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.964293:0:16661:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297452.964319:0:16661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297452.970428:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:1.0:1789297452.970473:0:3295:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.970647:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1789297452.970659:0:15114:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:2.0:1789297452.970882:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789297452.970900:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142400 00000100:00100000:2.0:1789297452.970909:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142400 00000100:00100000:2.0:1789297452.970957:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:2.0:1789297452.970961:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142528 00000100:00100000:2.0:1789297452.970964:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142528 00000100:00100000:1.0:1789297452.972064:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:1.0:1789297452.972082:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:2355:x1876213933142144:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:1.0:1789297452.972128:0:16662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.972148:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.972164:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1789297452.972173:0:16662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297452.972190:0:16662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297452.997613:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297452.997859:0:3296:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:3.0:1789297452.998212:0:15114:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789297452.998223:0:15114:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_005' 00000100:00100000:3.0:1789297452.998250:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789297452.998258:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142656 00000100:00100000:3.0:1789297452.998268:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142656 00000100:00100000:3.0:1789297452.998328:0:15115:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 5 min 3 max 116 00000100:00100000:3.0:1789297452.998332:0:15115:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142784 00000100:00100000:3.0:1789297452.998335:0:15115:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142784 00000100:00100000:2.0:1789297453.011786:0:16663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:2.0:1789297453.011807:0:16663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b067b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+17:2355:x1876213933142272:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:2.0:1789297453.011856:0:16663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.011880:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.011885:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.011893:0:16663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.011911:0:16663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789297453.131814:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1789297453.131848:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:0.0:1789297453.132018:0:15113:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:0.0:1789297453.132023:0:15113:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1789297451 -> 1789297453 00002000:00010000:0.0:1789297453.132026:0:15113:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1789297451 -> 1789297453 00002000:00010000:0.0:1789297453.132028:0:15113:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2051 00010000:00010000:0.0:1789297453.132043:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132058:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132067:0:15113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132082:0:15113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b0152b600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:0.0:1789297453.132087:0:15113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132097:0:15113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132121:0:15113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132129:0:15113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000004eb674cd/0x8ad177e823a0cab6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1789297453.132234:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:2355:x1876213933141760:12345-192.168.202.43@tcp:4:dd.0 Request processed in 185127us (185398us total) trans 8589934598 rc 0/0 00000100:00100000:0.0:1789297453.132251:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 0 00000100:00100000:0.0:1789297453.132288:0:15113:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 4 00000100:00100000:0.0:1789297453.132301:0:15113:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+18:2355:x1876213933142400:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:0.0:1789297453.132338:0:15113:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132745:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:0.0:1789297453.132761:0:15113:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1789297453.132769:0:15113:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1789297453.132794:0:15113:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1789297453.178234:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1789297453.178331:0:16661:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 5242880 00002000:00010000:2.0:1789297453.178337:0:16661:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2051 -> 8199 00010000:00010000:2.0:1789297453.178353:0:16661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178367:0:16661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178376:0:16661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178384:0:16661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b27938a00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297453.178389:0:16661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178398:0:16661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178420:0:16661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178429:0:16661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b64b2187/0x8ad177e823a0cabd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297453.178518:0:16661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b27af6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:2355:x1876213933142016:12345-192.168.202.43@tcp:4:dd.0 Request processed in 219327us (220762us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1789297453.178544:0:16661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 1 00000100:00100000:2.0:1789297453.178588:0:16661:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 5 00000001:00080000:3.0:1789297453.178600:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00000100:00100000:2.0:1789297453.178601:0:16661:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:2355:x1876213933142528:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:2.0:1789297453.178635:0:16661:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178648:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.178653:0:16661:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.178659:0:16661:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.178671:0:16661:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179002:0:16663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179012:0:16663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179021:0:16663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179029:0:16663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256800 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297453.179032:0:16663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179053:0:16663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179065:0:16663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179072:0:16663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000094c8d12f/0x8ad177e823a0cacb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297453.179112:0:16663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+15:2355:x1876213933142272:12345-192.168.202.43@tcp:4:dd.0 Request processed in 167312us (221260us total) trans 8589934601 rc 0/0 00000100:00100000:2.0:1789297453.179120:0:16663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 3 00000100:00100000:2.0:1789297453.179139:0:16663:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 6 00000100:00100000:2.0:1789297453.179147:0:16663:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:2355:x1876213933142656:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:2.0:1789297453.179164:0:16663:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179173:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.179177:0:16663:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.179182:0:16663:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179192:0:16663:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179324:0:16662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179333:0:16662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179339:0:16662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179345:0:16662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b382b2c00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297453.179348:0:16662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179356:0:16662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179367:0:16662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179373:0:16662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c6400575/0x8ad177e823a0cac4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297453.179412:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b067b1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+14:2355:x1876213933142144:12345-192.168.202.43@tcp:4:dd.0 Request processed in 207336us (221594us total) trans 8589934600 rc 0/0 00000100:00100000:2.0:1789297453.179420:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 2 00000100:00100000:2.0:1789297453.179503:0:16662:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 7 00000100:00100000:2.0:1789297453.179511:0:16662:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+13:2355:x1876213933142784:12345-192.168.202.43@tcp:4:dd.0 00010000:00010000:2.0:1789297453.179527:0:16662:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179535:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.179538:0:16662:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1789297453.179541:0:16662:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.179549:0:16662:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1789297453.220231:0:15113:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 5242880 -> 7654321 00002000:00010000:2.0:1789297453.220242:0:15113:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 10247 00010000:00010000:2.0:1789297453.220258:0:15113:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.220271:0:15113:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.220280:0:15113:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.220288:0:15113:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b40ffae00 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297453.220293:0:15113:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.220323:0:15113:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.220346:0:15113:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.220552:0:15113:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ff0043a7/0x8ad177e823a0cad2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 5 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15113 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297453.220641:0:15113:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+19:2355:x1876213933142400:12345-192.168.202.43@tcp:4:dd.0 Request processed in 88340us (250220us total) trans 8589934602 rc 0/0 00000100:00100000:2.0:1789297453.220651:0:15113:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 4 00000001:00080000:2.0:1789297453.220739:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00010000:00010000:2.0:1789297453.244916:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1789297453.268646:0:16663:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 10247 -> 16391 00010000:00010000:1.0:1789297453.268670:0:16663:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297453.268685:0:16663:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297453.268813:0:16663:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297453.268822:0:16663:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:1.0:1789297453.268828:0:16663:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297453.268838:0:16663:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297453.268863:0:16663:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1789297453.268871:0:16663:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000005a34dc2e/0x8ad177e823a0cae0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16663 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1789297453.269010:0:16663:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_005:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+15:2355:x1876213933142656:12345-192.168.202.43@tcp:4:dd.0 Request processed in 89859us (271403us total) trans 8589934604 rc 0/0 00000100:00100000:1.0:1789297453.269022:0:16663:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 6 00010000:00010000:2.0:1789297453.269240:0:16662:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.269251:0:16662:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.269258:0:16662:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.269265:0:16662:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38257600 already unused, calling callback (ffffffffc1699350) 00010000:00010000:2.0:1789297453.269268:0:16662:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.269284:0:16662:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.269295:0:16662:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1789297453.269302:0:16662:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000029641e5/0x8ad177e823a0cae7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16662 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1789297453.269339:0:16662:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+13:2355:x1876213933142784:12345-192.168.202.43@tcp:4:dd.0 Request processed in 89828us (271480us total) trans 8589934605 rc 0/0 00000100:00100000:2.0:1789297453.269346:0:16662:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 7 00000001:00080000:2.0:1789297453.269386:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00000001:00080000:2.0:1789297453.269401:0:7644:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00010000:00010000:3.0:1789297453.269600:0:16661:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297453.269610:0:16661:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297453.269617:0:16661:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297453.269624:0:16661:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff982b38256400 already unused, calling callback (ffffffffc1699350) 00010000:00010000:3.0:1789297453.269627:0:16661:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297453.269642:0:16661:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297453.269654:0:16661:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1789297453.269662:0:16661:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ec425883/0x8ad177e823a0cad9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16661 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1789297453.269868:0:16661:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2355:x1876213933142528:12345-192.168.202.43@tcp:4:dd.0 Request processed in 91270us (299393us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1789297453.269877:0:16661:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 5 00000040:00080000:2.0:1789297453.821120:0:14458:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1789297453.821129:0:14458:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1789297453.821161:0:14458:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1789297453.821172:0:14458:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:3.0:1789297454.268818:0:14414:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1789297455.019508:0:16701:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000100:00100000:0.0:1789297455.037947:0:3304:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957240832:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1789297455.038037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297455.039673:0:15112:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957240832 00000100:00100000:3.0:1789297455.039690:0:15112:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957240832 00000100:00100000:3.0:1789297455.039940:0:15112:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789297455.040222:0:15112:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957240832:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1789297455.040269:0:15112:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3851419648 avail 3849322496 00000100:00080000:2.0:1789297455.040534:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1789297455.048298:0:15112:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3304:x1876213957240832:12345-0@lo:13:osp-pre-1-0.0 Request processed in 8339us (10249us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297455.048315:0:15112:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1789297455.048673:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:930f46ad-32d3-437c-8414-ecdb73298d0c:3305:1876213957240960:0@lo:400:kworker.0 00000100:00100000:3.0:1789297455.048768:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297455.051820:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957240960 00000100:00100000:2.0:1789297455.051842:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957240960 00000100:00100000:2.0:1789297455.051907:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789297455.051918:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3305:x1876213957240960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297455.052018:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:930f46ad-32d3-437c-8414-ecdb73298d0c+19:3305:x1876213957240960:12345-0@lo:400:kworker.0 Request processed in 103us (3249us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297455.052026:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1789297455.052096:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:930f46ad-32d3-437c-8414-ecdb73298d0c:3305:1876213957240960:0@lo:400:kworker.0 00000100:00100000:0.0:1789297455.059427:0:3304:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:0.0:1789297455.059442:0:3304:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff982b39ca1500, transno 8589934595 00000004:00080000:0.0:1789297455.059467:0:3304:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:0.0:1789297455.059510:0:3304:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3304:1876213957240832:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1789297455.065231:0:3302:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957241088:0@lo:400:kworker.0 00000100:00100000:2.0:1789297455.065312:0:3302:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1789297455.071821:0:3303:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957241216:0@lo:400:kworker.0 00000100:00100000:0.0:1789297455.071921:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1789297455.072367:0:15107:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957241088 00000100:00100000:2.0:1789297455.072379:0:15107:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957241088 00000100:00100000:2.0:1789297455.072672:0:15107:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1789297455.072685:0:15107:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b39ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957241088:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1789297455.072791:0:15107:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b39ca1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3302:x1876213957241088:12345-0@lo:400:kworker.0 Request processed in 109us (7478us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297455.072797:0:15107:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1789297455.073051:0:14426:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957241216 00000100:00100000:3.0:1789297455.073056:0:14426:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957241216 00000100:00100000:3.0:1789297455.073107:0:14426:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1789297455.073114:0:14426:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957241216:12345-0@lo:400:kworker.0 00000100:00080000:2.0:1789297455.073159:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1789297455.073199:0:3302:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3302:1876213957241088:0@lo:400:kworker.0 00000100:00100000:3.0:1789297455.074059:0:14426:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3303:x1876213957241216:12345-0@lo:400:kworker.0 Request processed in 944us (2136us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297455.074068:0:14426:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1789297455.074073:0:3303:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3303:1876213957241216:0@lo:400:kworker.0 00000100:00100000:1.0:1789297455.074128:0:3305:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1789297455.074140:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957241344:0@lo:400:kworker.0 00000100:00100000:1.0:1789297455.074180:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1789297455.074237:0:3305:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff982b0621c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957241472:0@lo:400:kworker.0 00000100:00100000:1.0:1789297455.074272:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1789297455.074546:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957241344 00000100:00100000:3.0:1789297455.074553:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957241344 00000100:00100000:3.0:1789297455.074598:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213957241472 00000100:00100000:3.0:1789297455.074602:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213957241472 00000100:00100000:3.0:1789297455.074624:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1789297455.074632:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957241344:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1789297455.074682:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3305:x1876213957241344:12345-0@lo:400:kworker.0 Request processed in 50us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1789297455.074689:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1789297455.074693:0:14427:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1789297455.074728:0:14427:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b0621df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957241472:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1789297455.074774:0:14427:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b0621df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3305:x1876213957241472:12345-0@lo:400:kworker.0 Request processed in 74us (500us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297455.074782:0:14427:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1789297455.075136:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1789297455.076944:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3305:1876213957241472:0@lo:400:kworker.0 00000100:00100000:3.0:1789297455.076970:0:3305:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff982b0621c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3305:1876213957241344:0@lo:400:kworker.0 00010000:00010000:3.0:1789297455.292894:0:15698:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1789297456.123424:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297456.123478:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297456.123522:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297456.123539:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933143168 00000100:00100000:0.0:1789297456.123546:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297456.123551:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933143168 00000100:00100000:0.0:1789297456.123562:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297456.123580:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:2.0:1789297456.123613:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933143680 00000100:00100000:2.0:1789297456.123616:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933143680 00000100:00100000:2.0:1789297456.123642:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:2.0:1789297456.123652:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2353:x1876213933143168:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:2.0:1789297456.123769:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e14a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2353:x1876213933143168:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 118us (290us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297456.123778:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 18 00000100:00100000:1.0:1789297456.123800:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933142912 00000100:00100000:2.0:1789297456.123804:0:15110:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933143296 00000100:00100000:1.0:1789297456.123805:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933142912 00000100:00100000:2.0:1789297456.123807:0:15110:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933143296 00000100:00100000:2.0:1789297456.123823:0:15110:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00100000:2.0:1789297456.123830:0:15110:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2353:x1876213933143680:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:1.0:1789297456.123832:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 123 00000100:00100000:1.0:1789297456.123838:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b3bde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2353:x1876213933142912:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297456.131395:0:3297:0:(events.c:340:request_in_callback()) peer: 12345-192.168.202.43@tcp (source: 12345-192.168.202.43@tcp) 00000100:00100000:0.0:1789297456.131697:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933143424 00000100:00100000:0.0:1789297456.131739:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933143424 00000100:00100000:0.0:1789297456.131817:0:14425:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933143040 00000100:00100000:0.0:1789297456.131821:0:14425:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933143040 00000100:00100000:0.0:1789297456.131851:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789297456.131861:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68d12f81-8505-4ba9-b09f-f083255d6291+6:2353:x1876213933143424:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297456.131946:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e16680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:68d12f81-8505-4ba9-b09f-f083255d6291+6:2353:x1876213933143424:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 87us (8422us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297456.131953:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 28 00000100:00100000:0.0:1789297456.131971:0:14425:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:0.0:1789297456.131977:0:14425:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:2353:x1876213933143040:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297456.132006:0:14425:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e15180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+20:2353:x1876213933143040:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 29us (8443us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297456.132012:0:14425:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 29 00000100:00100000:0.0:1789297456.132032:0:15109:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1876213933143552 00000100:00100000:0.0:1789297456.132036:0:15109:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1876213933143552 00000100:00100000:0.0:1789297456.132058:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789297456.132065:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2353:x1876213933143296:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297456.132385:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38690000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:04eaf21b-7588-4cee-9d8c-40abfbdb26cc+5:2353:x1876213933143296:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 318us (8801us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297456.132393:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 20 00000100:00100000:0.0:1789297456.132411:0:15109:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:0.0:1789297456.132419:0:15109:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff982b38691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68d12f81-8505-4ba9-b09f-f083255d6291+5:2353:x1876213933143552:12345-192.168.202.43@tcp:400:kworker.0 00000100:00100000:0.0:1789297456.132448:0:15109:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b38691500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:68d12f81-8505-4ba9-b09f-f083255d6291+5:2353:x1876213933143552:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 31us (1065us total) trans 0 rc 0/0 00000100:00100000:0.0:1789297456.132468:0:15109:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 21 00000100:00100000:2.0:1789297456.141469:0:15110:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b41e17b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:68d12f81-8505-4ba9-b09f-f083255d6291+5:2353:x1876213933143680:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 17622us (17904us total) trans 0 rc 0/0 00000100:00100000:2.0:1789297456.142635:0:15110:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 19 00000100:00080000:2.0:1789297456.142719:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1789297456.142737:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1789297456.142741:0:14421:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1789297456.156663:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff982b3bde6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:79a19869-c943-4bb1-ae55-8dacb3e6d501+13:2353:x1876213933142912:12345-192.168.202.43@tcp:400:kworker.0 Request processed in 32811us (33237us total) trans 0 rc 0/0 00000100:00100000:1.0:1789297456.156680:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.202.43@tcp, seq: 123 00010000:00010000:2.0:1789297456.321891:0:14413:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) Debug log: 29477 lines, 29477 kept, 0 dropped, 0 bad.